Feb 27 12:24:40 devstack cinder-volume[73050]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:24:40 devstack cinder-volume[73050]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:24:40 devstack cinder-volume[73050]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:24:41 devstack cinder-volume[73050]: INFO dbcounter [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Registered counter for database cinder Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_db.sqlalchemy.engines [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG dbcounter [-] [73050] Writer thread running {{(pid=73050) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:24:41 devstack cinder-volume[73050]: INFO cinder.rpc [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 12:24:41 devstack cinder-volume[73050]: INFO cinder.rpc [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_db.sqlalchemy.engines [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:24:41 devstack cinder-volume[73050]: INFO cinder.volume.manager [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Determined volume DB was empty at startup. Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG cinder.volume.manager [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73050) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 12:24:41 devstack cinder-volume[73050]: INFO cinder.volume.manager [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 12:24:41 devstack cinder-volume[73050]: WARNING stevedore.named [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:24:41 devstack cinder-volume[73050]: WARNING castellan.key_manager [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:24:41 devstack cinder-volume[73050]: WARNING cinder.keymgr.conf_key_mgr [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG cinder.volume.drivers.lvm [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73050) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_concurrency.processutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73050) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_concurrency.processutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.256s {{(pid=73050) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_db.sqlalchemy.engines [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:24:41 devstack cinder-volume[73050]: INFO cinder.rpc [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 12:24:41 devstack cinder-volume[73050]: INFO cinder.rpc [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 12:24:41 devstack cinder-volume[73050]: WARNING stevedore.named [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:24:41 devstack cinder-volume[73050]: WARNING castellan.key_manager [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:24:41 devstack cinder-volume[73050]: INFO cinder.volume.manager [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_db.sqlalchemy.engines [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73050) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:24:41 devstack cinder-volume[73050]: INFO oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Starting 1 workers Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Started child 73150 {{(pid=73050) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Full set of CONF: {{(pid=73050) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] ******************************************************************************** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Configuration options gathered from: {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] ================================================================================ {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] allow_availability_zone_fallback = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] allow_compression_on_image_upload = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] allowed_direct_url_schemes = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] api_rate_limit = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73150]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] auth_strategy = keystone {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] az_cache_duration = 3600 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_availability_zone = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_host = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_stats_polling_interval = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backup_api_class = cinder.backup.api.API {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backup_name_template = backup-%s {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backup_use_same_host = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backup_use_temp_snapshot = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] chap_password = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] chap_username = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_internal_tenant_project_id = af93cd7a1cd34a99a224990573a00bd0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_internal_tenant_user_id = a4c9dcc8af4243f285c287a1a19ab217 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cloned_volume_same_az = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cluster = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] compression_format = gzip {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] compute_api_class = cinder.compute.nova.API {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] config_dir = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] config_source = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] control_exchange = openstack {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] debug = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] default_availability_zone = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] default_group_type = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] default_volume_type = lvmdriver-1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] disk_geometry = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] driver_client_cert = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] driver_client_cert_key = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] driver_data_namespace = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] driver_ssl_cert_path = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] driver_ssl_cert_verify = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] driver_use_ssl = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] enable_force_upload = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] enable_new_services = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] enable_unsupported_driver = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] enforce_multipath_for_image_xfer = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] filter_function = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_api_insecure = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_api_ssl_compression = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_ca_certificates_file = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_catalog_info = image:glance:publicURL {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_num_retries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance_request_timeout = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] goodness_function = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] graceful_shutdown_timeout = 5 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] group_api_class = cinder.group.api.API {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] host = devstack {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_compress_on_upload = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_conversion_address_space_limit = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_conversion_cpu_limit = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_conversion_disable = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_upload_use_cinder_backend = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_upload_use_internal_tenant = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_volume_cache_enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_volume_cache_max_count = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] image_volume_cache_max_size_gb = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] init_host_max_objects_retrieval = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] instance_format = [instance: %(uuid)s] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] iscsi_target_flags = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] iscsi_write_cache = on {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] iser_helper = tgtadm {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] iser_ip_address = 192.168.122.96 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] iser_port = 3260 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_color = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_config_append = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_dir = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_file = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_options = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_rotate_interval = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_rotate_interval_type = days {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] log_rotation_type = none {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] max_age = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] max_logfile_count = 30 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] max_logfile_size_mb = 200 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] max_over_subscription_ratio = 20.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] message_reap_interval = 86400 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] message_ttl = 2592000 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] migration_create_volume_timeout_secs = 300 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] monkey_patch = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] monkey_patch_modules = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] my_ip = 192.168.122.96 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73150]: INFO cinder.volume.manager [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] no_snapshot_gb_quota = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] num_iser_scan_tries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] num_shell_tries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] num_volume_device_scan_tries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] nvmeof_conn_info_version = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] nvmet_ns_id = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] nvmet_port_id = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] osapi_max_limit = 1000 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] osapi_volume_ext_list = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] osapi_volume_listen_port = 8776 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] osapi_volume_use_ssl = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] osapi_volume_workers = 2 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] per_volume_size_limit = -1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] periodic_fuzzy_delay = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] periodic_interval = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] public_endpoint = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] publish_errors = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] quota_backup_gigabytes = 1000 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] quota_backups = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] quota_gigabytes = 1000 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] quota_groups = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] quota_snapshots = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] quota_volumes = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] rate_limit_burst = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] rate_limit_except_level = CRITICAL {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] rate_limit_interval = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] reinit_driver_count = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] replication_device = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] report_discard_supported = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] report_interval = 120 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] reservation_clean_interval = 86400 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] reservation_expire = 86400 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] reserved_image_namespaces = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] reserved_percentage = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] rpc_response_timeout = 120 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] run_external_periodic_tasks = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] scst_target_driver = iscsi {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] scst_target_iqn_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_down_time = 720 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] shell_completion = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] snapshot_name_template = snapshot-%s {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] snapshot_same_host = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] split_loggers = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] state_path = /opt/stack/data/cinder {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] storage_availability_zone = nova {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] storage_protocol = iSCSI {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] syslog_log_facility = LOG_USER {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] target_helper = lioadm {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] target_ip_address = 192.168.122.96 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] target_port = 3260 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] target_protocol = iscsi {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] target_secondary_ip_addresses = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] trace_flags = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] transport_url = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] until_refresh = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] use_chap_auth = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] use_default_quota_class = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] use_journal = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] use_json = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] use_multipath_for_image_xfer = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] use_stderr = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] use_syslog = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] verify_glance_signatures = enabled {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_api_class = cinder.volume.api.API {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_backend_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_clear = zero {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_clear_ionice = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_clear_size = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_copy_bps_limit = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_dd_blocksize = 1M {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_name_template = volume-%s {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_service_inithost_offload = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volume_usage_audit_period = month {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] zoning_mode = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_concurrency.disable_process_locking = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.admin_password = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.admin_token = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.admin_user = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_port = 35357 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_protocol = https {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_section = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_type = password {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_uri = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.auth_version = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.cache = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.identity_uri = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.include_service_catalog = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.insecure = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.interface = public {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_password = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcache_username = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.region_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.service_type = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.backend = dogpile.cache.null {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.backend_argument = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.backend_expiration_time = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.config_prefix = cache.oslo {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.debug_cache_backend = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.enable_retry_client = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.enable_socket_keepalive = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.enforce_fips_mode = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.expiration_time = 600 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.hashclient_retry_attempts = 2 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.memcache_dead_retry = 300 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.memcache_pool_maxsize = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.memcache_sasl_enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.password = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.proxies = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.redis_db = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.redis_server = localhost:6379 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.retry_attempts = 2 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.retry_delay = 0.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.socket_keepalive_count = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.socket_keepalive_idle = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.socket_keepalive_interval = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.socket_timeout = 1.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.tls_allowed_ciphers = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.tls_cafile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.tls_certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.tls_enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.tls_keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cache.username = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] coordination.backend_url = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.asyncio_connection = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.asyncio_slave_connection = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.backend = sqlalchemy {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.connection = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.connection_debug = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.connection_parameters = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.connection_recycle_time = 3600 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.connection_trace = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.db_inc_retry_interval = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.db_max_retries = 20 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.db_max_retry_interval = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.db_retry_interval = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.max_overflow = 50 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.max_pool_size = 5 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.max_retries = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.mysql_wsrep_sync_wait = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.pool_timeout = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.retry_interval = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.slave_connection = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.sqlite_synchronous = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.synchronous_reader = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] database.use_db_reconnect = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.connection_string = messaging:// {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.es_doc_type = notification {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.es_scroll_size = 10000 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.es_scroll_time = 2m {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.filter_error_trace = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.hmac_keys = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.sentinel_service_name = mymaster {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.socket_timeout = 0.1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.trace_requests = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler.trace_sqlalchemy = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler_jaeger.process_tags = {} {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler_jaeger.service_name_prefix = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] profiler_otlp.service_name_prefix = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.enforce_new_defaults = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: WARNING oslo_config.cfg [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.enforce_scope = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.policy_default_rule = default {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.policy_file = policy.yaml {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] privsep_osbrick.group = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] privsep_osbrick.helper_command = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] privsep_osbrick.user = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_sys_admin.group = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_sys_admin.helper_command = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] cinder_sys_admin.user = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.auth_section = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.auth_type = password {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.cafile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.collect_timing = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.insecure = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.send_service_user_token = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.split_loggers = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] service_user.timeout = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.auth_section = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.auth_type = password {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.collect_timing = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.insecure = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.region_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.split_loggers = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] glance.timeout = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.backend_availability_zone = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.chap_password = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.chap_username = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.disk_geometry = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.driver_client_cert = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.driver_client_cert_key = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.driver_data_namespace = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.driver_use_ssl = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.extra_capabilities = {} {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.filter_function = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.goodness_function = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.iscsi_target_flags = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.iscsi_write_cache = on {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.iser_helper = tgtadm {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.iser_port = 3260 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.lvm_share_target = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.lvm_type = auto {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.num_shell_tries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.replication_device = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.report_discard_supported = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.reserved_percentage = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.target_helper = tgtadm {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.target_port = 3260 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.target_protocol = iscsi {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.trace_flags = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.unique_fqdn_network = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.use_chap_auth = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_backend_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_clear = zero {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_clear_ionice = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_clear_size = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_reports.file_event_handler = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_reports.log_dir = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.backend_host = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.chap_password = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.chap_username = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.disk_geometry = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.driver_client_cert = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.extra_capabilities = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.filter_function = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.goodness_function = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.iser_helper = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.iser_ip_address = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.iser_port = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.lvm_share_target = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.lvm_type = auto {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.num_shell_tries = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.replication_device = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.report_discard_supported = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.reserved_percentage = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.scst_target_driver = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.storage_protocol = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.target_helper = lioadm {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.target_ip_address = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.target_port = 3260 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.trace_flags = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.use_chap_auth = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_clear = zero {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_clear_size = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] lvmdriver-1.volumes_dir = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.ssl = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_notifications.driver = [] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_notifications.retry = -1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] key_manager.fixed_key = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.barbican_api_version = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.barbican_endpoint = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.barbican_endpoint_type = public {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.barbican_region_name = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.cafile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack sudo[73160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.collect_timing = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.insecure = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack sudo[73160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.number_of_retries = 60 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.retry_delay = 1 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.send_service_user_token = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.split_loggers = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.timeout = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.verify_ssl = True {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican.verify_ssl_path = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.auth_section = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.auth_type = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.cafile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.certfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.collect_timing = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.insecure = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.keyfile = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.split_loggers = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] barbican_service_user.timeout = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.approle_role_id = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.approle_secret_id = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.kv_mountpoint = secret {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.kv_path = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.kv_version = 2 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.namespace = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.root_token_id = **** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.ssl_ca_crt_file = None {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.timeout = 60.0 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.use_ssl = False {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:24:41 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] ******************************************************************************** {{(pid=73050) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 12:24:42 devstack sudo[73160]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:42 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:42 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:42 devstack sudo[73211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:42 devstack sudo[73211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:42 devstack sudo[73211]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:42 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.508s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:42 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:24:42 devstack cinder-volume[73150]: INFO cinder.brick.local_dev.lvm [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 12:24:42 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:42 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:42 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:42 devstack sudo[73450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:24:42 devstack sudo[73450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:43 devstack sudo[73450]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:43 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.538s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:43 devstack cinder-volume[73150]: DEBUG cinder.brick.local_dev.lvm [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73150) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 12:24:43 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:43 devstack sudo[73642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:43 devstack sudo[73642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:44 devstack sudo[73642]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:44 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.027s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:44 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:44 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:44 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:44 devstack sudo[73818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:44 devstack sudo[73818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:45 devstack sudo[73818]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:45 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:45 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:45 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:45 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:45 devstack sudo[73842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 12:24:45 devstack sudo[73842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:45 devstack sudo[73842]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:45 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.516s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:45 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:45 devstack sudo[73845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:24:45 devstack sudo[73845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:46 devstack sudo[73845]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:46 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:46 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:46 devstack sudo[73853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:24:46 devstack sudo[73853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:46 devstack sudo[73853]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:46 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:46 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:46 devstack sudo[73856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:24:46 devstack sudo[73856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:47 devstack sudo[73856]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:47 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:47 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:47 devstack sudo[73861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:47 devstack sudo[73861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:47 devstack sudo[73861]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:47 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:47 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:47 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:47 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:47 devstack sudo[73866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:47 devstack sudo[73866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:48 devstack sudo[73866]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.551s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:48 devstack cinder-volume[73150]: INFO cinder.volume.drivers.lvm [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:48 devstack sudo[73988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:48 devstack sudo[73988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:48 devstack sudo[73988]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG cinder.volume.drivers.lvm [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Updating volume stats {{(pid=73150) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:48 devstack sudo[74019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:24:48 devstack sudo[74019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:48 devstack sudo[74019]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:48 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:49 devstack sudo[74129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:24:49 devstack sudo[74129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:49 devstack sudo[74129]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:49 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:49 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:49 devstack sudo[74132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:49 devstack sudo[74132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:49 devstack sudo[74132]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:49 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:49 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:49 devstack sudo[74138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:24:49 devstack sudo[74138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:50 devstack sudo[74138]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:50 devstack cinder-volume[73150]: INFO cinder.volume.driver [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG cinder.volume.driver [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73150) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG oslo_db.sqlalchemy.engines [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG dbcounter [-] [73150] Writer thread running {{(pid=73150) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG cinder.db.sqlalchemy.api [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Building query based on filter {{(pid=73150) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG cinder.image.image_utils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73150) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 12:24:50 devstack cinder-volume[73150]: INFO cinder.keymgr.migration [None req-447f66d3-feaf-47c6-89d9-7fa9b51ff49b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG cinder.volume.drivers.lvm [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Updating volume stats {{(pid=73150) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:50 devstack sudo[74144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:24:50 devstack sudo[74144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:50 devstack sudo[74144]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:50 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:50 devstack sudo[74147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:24:50 devstack sudo[74147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:51 devstack sudo[74147]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:51 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:51 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:51 devstack sudo[74152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:51 devstack sudo[74152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:51 devstack cinder-volume[73050]: DEBUG dbcounter [-] [73050] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73050) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:24:51 devstack sudo[74152]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:51 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:51 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:51 devstack sudo[74160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:24:51 devstack sudo[74160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:52 devstack sudo[74160]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG cinder.manager [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Notifying Schedulers of capabilities ... {{(pid=73150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:24:52 devstack cinder-volume[73150]: INFO cinder.volume.manager [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Driver initialization completed successfully. Feb 27 12:24:52 devstack cinder-volume[73150]: INFO cinder.manager [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Initiating service 2 cleanup Feb 27 12:24:52 devstack cinder-volume[73150]: INFO cinder.manager [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Service 2 cleanup completed. Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG cinder.service [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Creating RPC server for service cinder-volume {{(pid=73150) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG cinder.service [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73150) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 12:24:52 devstack cinder-volume[73150]: INFO cinder.volume.manager [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG cinder.volume.drivers.lvm [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Updating volume stats {{(pid=73150) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:52 devstack sudo[74165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:24:52 devstack sudo[74165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:52 devstack sudo[74165]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:52 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:52 devstack sudo[74222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:24:52 devstack sudo[74222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:53 devstack sudo[74222]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:53 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:53 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:53 devstack sudo[74225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:24:53 devstack sudo[74225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:53 devstack sudo[74225]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:53 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:53 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:24:53 devstack sudo[74293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:24:53 devstack sudo[74293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:24:54 devstack sudo[74293]: pam_unix(sudo:session): session closed for user root Feb 27 12:24:54 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:24:54 devstack cinder-volume[73150]: INFO cinder.volume.manager [None req-799bb072-87c4-4dc5-8bf7-92bf41548758 None None] Driver post RPC initialization completed successfully. Feb 27 12:25:04 devstack cinder-volume[73150]: DEBUG dbcounter [-] [73150] Writing DB stats cinder:SELECT=3 {{(pid=73150) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:25:04 devstack cinder-volume[73150]: DEBUG dbcounter [-] [73150] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73150) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:26:10 devstack cinder-volume[73150]: DEBUG oslo_service.periodic_task [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73150) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:26:10 devstack cinder-volume[73150]: DEBUG cinder.volume.drivers.lvm [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Updating volume stats {{(pid=73150) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:26:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:10 devstack sudo[79390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:26:10 devstack sudo[79390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:10 devstack sudo[79390]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:10 devstack sudo[79393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:26:10 devstack sudo[79393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:11 devstack sudo[79393]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:11 devstack sudo[79398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:26:11 devstack sudo[79398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:11 devstack sudo[79398]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:26:11 devstack sudo[79402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:26:11 devstack sudo[79402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:26:12 devstack sudo[79402]: pam_unix(sudo:session): session closed for user root Feb 27 12:26:12 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:26:12 devstack cinder-volume[73150]: DEBUG cinder.manager [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Notifying Schedulers of capabilities ... {{(pid=73150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:27:04 devstack cinder-volume[73150]: DEBUG dbcounter [-] [73150] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73150) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:27:10 devstack cinder-volume[73150]: DEBUG oslo_service.periodic_task [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73150) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:27:10 devstack cinder-volume[73150]: DEBUG cinder.volume.drivers.lvm [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Updating volume stats {{(pid=73150) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:27:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:10 devstack sudo[80415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:27:10 devstack sudo[80415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:10 devstack sudo[80415]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:10 devstack sudo[80442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:27:10 devstack sudo[80442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:11 devstack sudo[80442]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:11 devstack sudo[80486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:27:11 devstack sudo[80486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:11 devstack sudo[80486]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:27:11 devstack sudo[80511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:27:11 devstack sudo[80511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:27:12 devstack sudo[80511]: pam_unix(sudo:session): session closed for user root Feb 27 12:27:12 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:27:12 devstack cinder-volume[73150]: DEBUG cinder.manager [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Notifying Schedulers of capabilities ... {{(pid=73150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:10 devstack cinder-volume[73150]: DEBUG oslo_service.periodic_task [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73150) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:28:10 devstack cinder-volume[73150]: DEBUG cinder.volume.drivers.lvm [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Updating volume stats {{(pid=73150) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 12:28:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:10 devstack sudo[81937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 12:28:10 devstack sudo[81937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:10 devstack sudo[81937]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:10 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:10 devstack sudo[81993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:28:10 devstack sudo[81993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:11 devstack sudo[81993]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:11 devstack sudo[82015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 12:28:11 devstack sudo[82015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:11 devstack sudo[82015]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:11 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:11 devstack sudo[82023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 12:28:11 devstack sudo[82023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:12 devstack sudo[82023]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:12 devstack cinder-volume[73150]: DEBUG oslo_concurrency.processutils [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:12 devstack cinder-volume[73150]: DEBUG cinder.manager [None req-f572c8c9-9b9a-473a-bb3c-a682aed51366 None None] Notifying Schedulers of capabilities ... {{(pid=73150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:37 devstack cinder-volume[73050]: INFO oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Caught SIGTERM, stopping children Feb 27 12:28:37 devstack cinder-volume[73050]: DEBUG oslo_concurrency.lockutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Acquiring lock "singleton_lock" {{(pid=73050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:28:37 devstack cinder-volume[73050]: DEBUG oslo_concurrency.lockutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Acquired lock "singleton_lock" {{(pid=73050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:28:37 devstack cinder-volume[73050]: DEBUG oslo_concurrency.lockutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Releasing lock "singleton_lock" {{(pid=73050) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:28:37 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Stop services. {{(pid=73050) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 12:28:37 devstack cinder-volume[73050]: DEBUG oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Killing children. {{(pid=73050) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 12:28:37 devstack cinder-volume[73050]: INFO oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Waiting on 1 children to exit Feb 27 12:28:37 devstack cinder-volume[73150]: DEBUG oslo_concurrency.lockutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Acquiring lock "singleton_lock" {{(pid=73150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:28:37 devstack cinder-volume[73150]: DEBUG oslo_concurrency.lockutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Acquired lock "singleton_lock" {{(pid=73150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:28:37 devstack cinder-volume[73150]: DEBUG oslo_concurrency.lockutils [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Releasing lock "singleton_lock" {{(pid=73150) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:28:37 devstack cinder-volume[73150]: WARNING amqp [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:28:37 devstack cinder-volume[73150]: WARNING amqp [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:28:37 devstack cinder-volume[73050]: INFO oslo_service.backend._eventlet.service [None req-10b19150-e88c-4060-92f2-16976822c6a9 None None] Child 73150 exited with status 0 Feb 27 12:28:39 devstack cinder-volume[82602]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82602) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:28:39 devstack cinder-volume[82602]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82602) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:28:39 devstack cinder-volume[82602]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82602) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:28:40 devstack cinder-volume[82602]: INFO dbcounter [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Registered counter for database cinder Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_db.sqlalchemy.engines [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82602) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG dbcounter [-] [82602] Writer thread running {{(pid=82602) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:28:40 devstack cinder-volume[82602]: INFO cinder.rpc [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 12:28:40 devstack cinder-volume[82602]: INFO cinder.rpc [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_db.sqlalchemy.engines [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82602) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:40 devstack cinder-volume[82602]: INFO cinder.volume.manager [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Determined volume DB was empty at startup. Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG cinder.volume.manager [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82602) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 12:28:40 devstack cinder-volume[82602]: INFO cinder.volume.manager [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 12:28:40 devstack cinder-volume[82602]: WARNING stevedore.named [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:28:40 devstack cinder-volume[82602]: WARNING castellan.key_manager [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:28:40 devstack cinder-volume[82602]: WARNING cinder.keymgr.conf_key_mgr [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:28:40 devstack cinder-volume[82602]: INFO cinder.volume.manager [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_db.sqlalchemy.engines [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82602) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:40 devstack cinder-volume[82602]: INFO oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Starting 1 workers Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Started child 82719 {{(pid=82602) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Full set of CONF: {{(pid=82602) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] ******************************************************************************** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Configuration options gathered from: {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] ================================================================================ {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 12:28:40 devstack cinder-volume[82719]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] allow_availability_zone_fallback = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] allow_compression_on_image_upload = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] allowed_direct_url_schemes = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] api_rate_limit = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] auth_strategy = keystone {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_availability_zone = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_host = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_stats_polling_interval = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backup_api_class = cinder.backup.api.API {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backup_name_template = backup-%s {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backup_use_same_host = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backup_use_temp_snapshot = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] chap_password = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] chap_username = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_internal_tenant_project_id = af93cd7a1cd34a99a224990573a00bd0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_internal_tenant_user_id = a4c9dcc8af4243f285c287a1a19ab217 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cluster = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] compression_format = gzip {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] compute_api_class = cinder.compute.nova.API {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] config_dir = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] config_source = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] control_exchange = openstack {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] debug = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] default_availability_zone = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] default_group_type = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] default_volume_type = QuobyteHD {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] disk_geometry = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] driver_client_cert = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] driver_client_cert_key = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] driver_data_namespace = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] driver_ssl_cert_path = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] driver_ssl_cert_verify = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] driver_use_ssl = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] enable_new_services = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] enable_unsupported_driver = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] enabled_backends = ['QuobyteHD'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] enforce_multipath_for_image_xfer = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] filter_function = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_api_insecure = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_api_ssl_compression = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_ca_certificates_file = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_catalog_info = image:glance:publicURL {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_num_retries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance_request_timeout = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] goodness_function = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] graceful_shutdown_timeout = 5 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] group_api_class = cinder.group.api.API {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] host = devstack {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_compress_on_upload = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_conversion_address_space_limit = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_conversion_cpu_limit = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_conversion_disable = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_upload_use_cinder_backend = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_upload_use_internal_tenant = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_volume_cache_enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_volume_cache_max_count = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] image_volume_cache_max_size_gb = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] init_host_max_objects_retrieval = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] instance_format = [instance: %(uuid)s] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] iscsi_target_flags = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] iscsi_write_cache = on {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] iser_helper = tgtadm {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] iser_ip_address = 192.168.122.96 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.remotefs [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82719) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] iser_port = 3260 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_color = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_config_append = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_dir = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_file = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_options = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_rotate_interval = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_rotate_interval_type = days {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] log_rotation_type = none {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] max_age = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] max_logfile_count = 30 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] max_logfile_size_mb = 200 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] max_over_subscription_ratio = 20.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] message_reap_interval = 86400 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] message_ttl = 2592000 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] migration_create_volume_timeout_secs = 300 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] monkey_patch = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] monkey_patch_modules = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] my_ip = 192.168.122.96 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] no_snapshot_gb_quota = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] num_iser_scan_tries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] num_shell_tries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] num_volume_device_scan_tries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] nvmeof_conn_info_version = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] nvmet_ns_id = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] nvmet_port_id = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] osapi_max_limit = 1000 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] osapi_volume_ext_list = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] osapi_volume_listen = 0.0.0.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] osapi_volume_listen_port = 8776 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] osapi_volume_use_ssl = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] osapi_volume_workers = 2 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] per_volume_size_limit = -1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] periodic_fuzzy_delay = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] periodic_interval = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] project_id_regex = [0-9a-f\-]+ {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] public_endpoint = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] publish_errors = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] quota_backup_gigabytes = 1000 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] quota_backups = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] quota_gigabytes = 1000 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] quota_groups = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] quota_snapshots = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] quota_volumes = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] rate_limit_burst = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] rate_limit_except_level = CRITICAL {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] rate_limit_interval = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] reinit_driver_count = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] replication_device = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] report_discard_supported = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] report_interval = 120 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] reservation_clean_interval = 86400 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] reservation_expire = 86400 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] reserved_image_namespaces = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] reserved_percentage = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] rpc_response_timeout = 120 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] run_external_periodic_tasks = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] scst_target_driver = iscsi {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] scst_target_iqn_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_down_time = 720 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] shell_completion = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] snapshot_name_template = snapshot-%s {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] split_loggers = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] state_path = /opt/stack/data/cinder {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] storage_availability_zone = nova {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] storage_protocol = iSCSI {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] syslog_log_facility = LOG_USER {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] target_helper = lioadm {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] target_ip_address = 192.168.122.96 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] target_port = 3260 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] target_protocol = iscsi {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] target_secondary_ip_addresses = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] trace_flags = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] transfer_api_class = cinder.transfer.api.API {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] transport_url = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] until_refresh = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] use_chap_auth = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] use_default_quota_class = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] use_journal = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] use_json = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] use_multipath_for_image_xfer = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] use_stderr = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] use_syslog = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] verify_glance_signatures = enabled {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_api_class = cinder.volume.api.API {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_backend_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_clear = zero {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_clear_ionice = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_clear_size = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_copy_bps_limit = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_dd_blocksize = 1M {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_name_template = volume-%s {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_service_inithost_offload = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volume_usage_audit_period = month {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] zoning_mode = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_concurrency.disable_process_locking = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.admin_password = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.admin_token = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.admin_user = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_admin_prefix = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_port = 35357 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_protocol = https {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_section = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_type = password {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_uri = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.auth_version = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.cache = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.delay_auth_decision = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.http_connect_timeout = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.identity_uri = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.include_service_catalog = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.insecure = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.interface = public {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_password = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82719) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: WARNING cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: WARNING cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcache_username = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.region_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Running cmd (subprocess): mount.quobyte {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.service_token_roles_required = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.service_type = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.token_cache_time = 300 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.backend = dogpile.cache.null {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.backend_argument = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.backend_expiration_time = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.config_prefix = cache.oslo {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.debug_cache_backend = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.enable_retry_client = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.enable_socket_keepalive = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.enforce_fips_mode = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.expiration_time = 600 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.hashclient_retry_attempts = 2 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.memcache_dead_retry = 300 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.memcache_pool_maxsize = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.memcache_sasl_enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.password = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.proxies = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.redis_db = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.redis_sentinel_service_name = mymaster {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.redis_server = localhost:6379 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.retry_attempts = 2 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.retry_delay = 0.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.socket_keepalive_count = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.socket_keepalive_idle = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.socket_keepalive_interval = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.socket_timeout = 1.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.tls_allowed_ciphers = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.tls_cafile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.tls_certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.tls_enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.tls_keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cache.username = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] coordination.backend_url = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.asyncio_connection = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.asyncio_slave_connection = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.backend = sqlalchemy {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.connection = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.connection_debug = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.connection_parameters = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.connection_recycle_time = 3600 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.connection_trace = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.db_inc_retry_interval = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.db_max_retries = 20 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.db_max_retry_interval = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.db_retry_interval = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.max_overflow = 50 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.max_pool_size = 5 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.max_retries = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.mysql_wsrep_sync_wait = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.pool_timeout = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.retry_interval = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.slave_connection = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.sqlite_synchronous = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.synchronous_reader = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] database.use_db_reconnect = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.connection_string = messaging:// {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.es_doc_type = notification {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.es_scroll_size = 10000 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.es_scroll_time = 2m {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.filter_error_trace = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.hmac_keys = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.sentinel_service_name = mymaster {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.socket_timeout = 0.1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.trace_requests = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler.trace_sqlalchemy = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler_jaeger.process_tags = {} {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler_jaeger.service_name_prefix = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] profiler_otlp.service_name_prefix = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.enforce_new_defaults = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: WARNING oslo_config.cfg [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.enforce_scope = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.policy_default_rule = default {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.policy_file = policy.yaml {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_policy.remote_timeout = 60.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] privsep_osbrick.group = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] privsep_osbrick.helper_command = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] privsep_osbrick.user = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_sys_admin.group = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_sys_admin.helper_command = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] cinder_sys_admin.user = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.auth_section = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.auth_type = password {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.cafile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.collect_timing = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.insecure = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.send_service_user_token = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.split_loggers = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] service_user.timeout = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.auth_section = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.auth_type = password {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.collect_timing = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.insecure = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.region_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.split_loggers = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] glance.timeout = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.backend_availability_zone = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.chap_password = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.chap_username = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.disk_geometry = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.driver_client_cert = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.driver_client_cert_key = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.driver_data_namespace = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.driver_use_ssl = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.enable_unsupported_driver = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.extra_capabilities = {} {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.filter_function = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.goodness_function = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.iscsi_target_flags = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.iscsi_write_cache = on {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.iser_helper = tgtadm {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.iser_port = 3260 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_host = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_login = admin {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_mount_options = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_password = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_private_key = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_share_path = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_ssh_port = 22 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.num_shell_tries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.nvmet_port_id = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.quobyte_client_cfg = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.quobyte_volume_url = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.replication_device = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.report_discard_supported = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.reserved_percentage = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.scst_target_driver = iscsi {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.scst_target_iqn_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.storage_protocol = iSCSI {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.target_helper = tgtadm {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.target_port = 3260 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.target_protocol = iscsi {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack quobyte-client[82720]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 12:28:40 devstack quobyte-client[82720]: Invalid parameters found, error: missing mount point. Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.trace_flags = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.unique_fqdn_network = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack quobyte-client[82720]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 12:28:40 devstack quobyte-client[82720]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.use_chap_auth = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_backend_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_clear = zero {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_clear_ionice = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_clear_size = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_reports.file_event_handler = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_reports.log_dir = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.backend_availability_zone = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.backend_host = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.chap_password = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.chap_username = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.chiscsi_conf = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.disk_geometry = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.driver_client_cert = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.driver_client_cert_key = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.driver_data_namespace = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.driver_use_ssl = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.extra_capabilities = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.filter_function = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.goodness_function = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.iscsi_target_flags = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.iscsi_write_cache = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.iser_helper = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.iser_ip_address = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.iser_port = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.iser_target_prefix = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_host = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_login = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_mount_options = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_password = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_private_key = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: INFO cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 ... Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_share_path = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad -c /etc/quobyte/client-cinder.cfg {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_ssh_port = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.num_shell_tries = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nvmet_ns_id = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.nvmet_port_id = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.replication_device = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.report_discard_supported = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.reserved_percentage = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.scst_target_driver = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.storage_protocol = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.target_helper = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.target_ip_address = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.target_port = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.target_prefix = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.target_protocol = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.trace_flags = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.unique_fqdn_network = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.use_chap_auth = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_clear = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_clear_ionice = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_clear_size = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] QuobyteHD.volumes_dir = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack sudo[82721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad -c /etc/quobyte/client-cinder.cfg Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack sudo[82721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.ssl = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.ssl_version = {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_notifications.driver = [] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_notifications.retry = -1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] oslo_messaging_notifications.transport_url = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] key_manager.fixed_key = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.barbican_api_version = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.barbican_endpoint = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.barbican_endpoint_type = public {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.barbican_region_name = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.cafile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.collect_timing = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.insecure = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.number_of_retries = 60 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.retry_delay = 1 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.send_service_user_token = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.split_loggers = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.timeout = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.verify_ssl = True {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican.verify_ssl_path = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.auth_section = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.auth_type = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.cafile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.certfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.collect_timing = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.insecure = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.keyfile = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.split_loggers = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] barbican_service_user.timeout = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.approle_role_id = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.approle_secret_id = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.kv_mountpoint = secret {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.kv_path = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.kv_version = 2 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.namespace = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.root_token_id = **** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.ssl_ca_crt_file = None {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.timeout = 60.0 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.use_ssl = False {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:40 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] ******************************************************************************** {{(pid=82602) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 12:28:41 devstack sudo[82721]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.508s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:41 devstack cinder-volume[82719]: INFO cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 succeeded Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.515s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:41 devstack sudo[82790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:28:41 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:41 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.399s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:41 devstack cinder-volume[82719]: INFO cinder.volume.driver [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG cinder.volume.driver [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82719) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_db.sqlalchemy.engines [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG dbcounter [-] [82719] Writer thread running {{(pid=82719) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG cinder.db.sqlalchemy.api [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Building query based on filter {{(pid=82719) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG cinder.image.image_utils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82719) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 12:28:41 devstack cinder-volume[82719]: INFO cinder.keymgr.migration [None req-42351fa8-73b5-4058-91f4-ed2a0fae0d16 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:41 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:41 devstack sudo[82793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:28:41 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:42 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.434s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG cinder.manager [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Notifying Schedulers of capabilities ... {{(pid=82719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:42 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Driver initialization completed successfully. Feb 27 12:28:42 devstack cinder-volume[82719]: INFO cinder.manager [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Initiating service 3 cleanup Feb 27 12:28:42 devstack cinder-volume[82719]: INFO cinder.manager [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Service 3 cleanup completed. Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG cinder.service [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Creating RPC server for service cinder-volume {{(pid=82719) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG cinder.service [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82719) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 12:28:42 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:42 devstack sudo[82798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:28:42 devstack sudo[82798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:42 devstack sudo[82798]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:42 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.426s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:42 devstack cinder-volume[82719]: INFO cinder.volume.manager [None req-c9549952-3806-49e2-b95b-75548c395ce2 None None] Driver post RPC initialization completed successfully. Feb 27 12:28:45 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:45 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:45 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=82719) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:45 devstack cinder-volume[82719]: DEBUG cinder.volume.drivers.quobyte [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=82719) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:45 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82719) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:45 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:45 devstack sudo[82864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:28:45 devstack sudo[82864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:46 devstack sudo[82864]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:46 devstack cinder-volume[82719]: DEBUG oslo_concurrency.processutils [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.441s {{(pid=82719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:46 devstack cinder-volume[82719]: DEBUG cinder.manager [None req-94837c78-20e1-4bf1-9f69-0f0eb7e00843 None None] Notifying Schedulers of capabilities ... {{(pid=82719) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:50 devstack cinder-volume[82602]: INFO oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Caught SIGTERM, stopping children Feb 27 12:28:50 devstack cinder-volume[82602]: DEBUG oslo_concurrency.lockutils [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Acquiring lock "singleton_lock" {{(pid=82602) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:28:50 devstack cinder-volume[82602]: DEBUG oslo_concurrency.lockutils [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Acquired lock "singleton_lock" {{(pid=82602) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:28:50 devstack cinder-volume[82602]: DEBUG oslo_concurrency.lockutils [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Releasing lock "singleton_lock" {{(pid=82602) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:28:50 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Stop services. {{(pid=82602) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 12:28:50 devstack cinder-volume[82602]: DEBUG oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Killing children. {{(pid=82602) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 12:28:50 devstack cinder-volume[82602]: INFO oslo_service.backend._eventlet.service [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Waiting on 1 children to exit Feb 27 12:28:52 devstack cinder-volume[82719]: DEBUG dbcounter [-] [82719] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82719) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:28:52 devstack cinder-volume[82719]: DEBUG dbcounter [-] [82719] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82719) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:28:55 devstack cinder-volume[82719]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Feb 27 12:28:55 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Acquiring lock "singleton_lock" {{(pid=82719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:28:55 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Acquired lock "singleton_lock" {{(pid=82719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:28:55 devstack cinder-volume[82719]: DEBUG oslo_concurrency.lockutils [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Releasing lock "singleton_lock" {{(pid=82719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:28:55 devstack cinder-volume[82719]: WARNING amqp [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:28:55 devstack cinder-volume[82719]: WARNING amqp [None req-b9068666-1caa-4dce-b9f8-f19ea0d0e27f None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 12:28:56 devstack cinder-volume[82972]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82972) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 12:28:56 devstack cinder-volume[82972]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82972) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 12:28:56 devstack cinder-volume[82972]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82972) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 12:28:57 devstack cinder-volume[82972]: INFO dbcounter [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Registered counter for database cinder Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_db.sqlalchemy.engines [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG dbcounter [-] [82972] Writer thread running {{(pid=82972) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:28:57 devstack cinder-volume[82972]: INFO cinder.rpc [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 12:28:57 devstack cinder-volume[82972]: INFO cinder.rpc [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_db.sqlalchemy.engines [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:57 devstack cinder-volume[82972]: INFO cinder.volume.manager [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Determined volume DB was empty at startup. Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG cinder.volume.manager [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82972) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 12:28:57 devstack cinder-volume[82972]: WARNING stevedore.named [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 12:28:57 devstack cinder-volume[82972]: WARNING castellan.key_manager [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:28:57 devstack cinder-volume[82972]: WARNING cinder.keymgr.conf_key_mgr [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 12:28:57 devstack cinder-volume[82972]: INFO cinder.volume.manager [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_db.sqlalchemy.engines [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:57 devstack cinder-volume[82972]: INFO oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Starting 1 workers Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Started child 83114 {{(pid=82972) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Full set of CONF: {{(pid=82972) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] ******************************************************************************** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Configuration options gathered from: {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] ================================================================================ {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] allow_availability_zone_fallback = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] allow_compression_on_image_upload = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] allowed_direct_url_schemes = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] api_rate_limit = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] auth_strategy = keystone {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_availability_zone = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_host = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_stats_polling_interval = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backup_api_class = cinder.backup.api.API {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backup_name_template = backup-%s {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backup_use_same_host = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backup_use_temp_snapshot = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] chap_password = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] chap_username = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_internal_tenant_project_id = af93cd7a1cd34a99a224990573a00bd0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_internal_tenant_user_id = a4c9dcc8af4243f285c287a1a19ab217 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cluster = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] compression_format = gzip {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] compute_api_class = cinder.compute.nova.API {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] config_dir = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] config_source = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] control_exchange = openstack {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] debug = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] default_availability_zone = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] default_group_type = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[83114]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] default_volume_type = QuobyteHD {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] disk_geometry = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] driver_client_cert = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] driver_client_cert_key = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] driver_data_namespace = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] driver_ssl_cert_path = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] driver_ssl_cert_verify = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] driver_use_ssl = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] enable_new_services = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] enable_unsupported_driver = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] enabled_backends = ['QuobyteHD'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] enforce_multipath_for_image_xfer = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] filter_function = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_api_insecure = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_api_ssl_compression = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_ca_certificates_file = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_catalog_info = image:glance:publicURL {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_num_retries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance_request_timeout = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] goodness_function = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] graceful_shutdown_timeout = 5 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] group_api_class = cinder.group.api.API {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] host = devstack {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_compress_on_upload = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_conversion_address_space_limit = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_conversion_cpu_limit = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_conversion_disable = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_upload_use_cinder_backend = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_upload_use_internal_tenant = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_volume_cache_enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_volume_cache_max_count = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] image_volume_cache_max_size_gb = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] init_host_max_objects_retrieval = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] instance_format = [instance: %(uuid)s] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] iscsi_target_flags = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] iscsi_write_cache = on {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] iser_helper = tgtadm {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] iser_ip_address = 192.168.122.96 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] iser_port = 3260 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_color = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_config_append = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_dir = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_file = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_options = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_rotate_interval = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_rotate_interval_type = days {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] log_rotation_type = none {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] max_age = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] max_logfile_count = 30 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] max_logfile_size_mb = 200 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] max_over_subscription_ratio = 20.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] message_reap_interval = 86400 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] message_ttl = 2592000 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] migration_create_volume_timeout_secs = 300 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] monkey_patch = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] monkey_patch_modules = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] my_ip = 192.168.122.96 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] no_snapshot_gb_quota = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] num_iser_scan_tries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] num_shell_tries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] num_volume_device_scan_tries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] nvmeof_conn_info_version = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] nvmet_ns_id = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] nvmet_port_id = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] osapi_max_limit = 1000 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] osapi_volume_ext_list = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] osapi_volume_listen_port = 8776 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] osapi_volume_use_ssl = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] osapi_volume_workers = 2 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] per_volume_size_limit = -1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] periodic_fuzzy_delay = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] periodic_interval = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] public_endpoint = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] publish_errors = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] quota_backup_gigabytes = 1000 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] quota_backups = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] quota_gigabytes = 1000 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] quota_groups = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] quota_snapshots = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] quota_volumes = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] rate_limit_burst = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] rate_limit_except_level = CRITICAL {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] rate_limit_interval = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] reinit_driver_count = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] replication_device = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] report_discard_supported = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] report_interval = 120 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] reservation_clean_interval = 86400 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] reservation_expire = 86400 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] reserved_image_namespaces = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] reserved_percentage = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] rpc_response_timeout = 120 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] run_external_periodic_tasks = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] scst_target_driver = iscsi {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] scst_target_iqn_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_down_time = 720 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] shell_completion = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] snapshot_name_template = snapshot-%s {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] split_loggers = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] state_path = /opt/stack/data/cinder {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] storage_availability_zone = nova {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] storage_protocol = iSCSI {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] syslog_log_facility = LOG_USER {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] target_helper = lioadm {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] target_ip_address = 192.168.122.96 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] target_port = 3260 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] target_protocol = iscsi {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] target_secondary_ip_addresses = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] trace_flags = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] transport_url = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] until_refresh = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] use_chap_auth = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] use_default_quota_class = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] use_journal = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] use_json = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] use_multipath_for_image_xfer = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] use_stderr = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] use_syslog = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] verify_glance_signatures = enabled {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_api_class = cinder.volume.api.API {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_backend_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_clear = zero {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_clear_ionice = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_clear_size = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_copy_bps_limit = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_dd_blocksize = 1M {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_name_template = volume-%s {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_service_inithost_offload = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volume_usage_audit_period = month {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] zoning_mode = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_concurrency.disable_process_locking = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.admin_password = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.admin_token = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.admin_user = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_port = 35357 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_protocol = https {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_section = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_type = password {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_uri = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.auth_version = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.cache = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.identity_uri = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.include_service_catalog = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.insecure = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.interface = public {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_password = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcache_username = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.region_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.service_type = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.backend = dogpile.cache.null {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.backend_argument = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.backend_expiration_time = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.config_prefix = cache.oslo {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.debug_cache_backend = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.enable_retry_client = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.enable_socket_keepalive = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.enforce_fips_mode = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.expiration_time = 600 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.hashclient_retry_attempts = 2 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.memcache_dead_retry = 300 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.memcache_pool_maxsize = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.memcache_sasl_enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.password = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.proxies = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.redis_db = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.redis_server = localhost:6379 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.retry_attempts = 2 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.retry_delay = 0.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.socket_keepalive_count = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.socket_keepalive_idle = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.socket_keepalive_interval = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.socket_timeout = 1.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.tls_allowed_ciphers = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.tls_cafile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.tls_certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.tls_enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.tls_keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cache.username = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] coordination.backend_url = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.asyncio_connection = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.asyncio_slave_connection = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.backend = sqlalchemy {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.connection = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.connection_debug = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.connection_parameters = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.connection_recycle_time = 3600 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.connection_trace = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.db_inc_retry_interval = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.db_max_retries = 20 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.db_max_retry_interval = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.db_retry_interval = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.max_overflow = 50 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.max_pool_size = 5 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.max_retries = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.mysql_wsrep_sync_wait = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.pool_timeout = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.retry_interval = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.slave_connection = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.sqlite_synchronous = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.synchronous_reader = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] database.use_db_reconnect = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.connection_string = messaging:// {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.es_doc_type = notification {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.es_scroll_size = 10000 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.es_scroll_time = 2m {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.filter_error_trace = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.hmac_keys = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.sentinel_service_name = mymaster {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.socket_timeout = 0.1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.trace_requests = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler.trace_sqlalchemy = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler_jaeger.process_tags = {} {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler_jaeger.service_name_prefix = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] profiler_otlp.service_name_prefix = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.enforce_new_defaults = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 12:28:57 devstack cinder-volume[82972]: WARNING oslo_config.cfg [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.enforce_scope = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.policy_default_rule = default {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.policy_file = policy.yaml {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] privsep_osbrick.group = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] privsep_osbrick.helper_command = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] privsep_osbrick.user = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_sys_admin.group = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_sys_admin.helper_command = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] cinder_sys_admin.user = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.auth_section = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.auth_type = password {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.cafile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.collect_timing = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.insecure = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.send_service_user_token = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.split_loggers = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] service_user.timeout = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.auth_section = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.auth_type = password {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.collect_timing = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.insecure = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.region_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.split_loggers = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] glance.timeout = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.backend_availability_zone = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.chap_password = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83114) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.chap_username = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.disk_geometry = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.driver_client_cert = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.driver_client_cert_key = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.driver_data_namespace = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.driver_use_ssl = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.extra_capabilities = {} {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.filter_function = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.goodness_function = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.iscsi_target_flags = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.iscsi_write_cache = on {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.iser_helper = tgtadm {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.iser_port = 3260 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_host = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_login = admin {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_mount_options = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_password = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_private_key = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_share_path = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.num_shell_tries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.quobyte_volume_url = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.replication_device = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.report_discard_supported = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.reserved_percentage = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.target_helper = tgtadm {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.target_port = 3260 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.target_protocol = iscsi {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.trace_flags = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.unique_fqdn_network = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.use_chap_auth = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_backend_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_clear = zero {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_clear_ionice = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_clear_size = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_reports.file_event_handler = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_reports.log_dir = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.backend_availability_zone = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.backend_host = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.chap_password = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.chap_username = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.chiscsi_conf = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.disk_geometry = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.driver_client_cert = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.driver_data_namespace = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.driver_use_ssl = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.extra_capabilities = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.filter_function = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.goodness_function = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.iser_helper = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.iser_ip_address = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.iser_port = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.iser_target_prefix = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_host = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_login = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_mount_options = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_password = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_private_key = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_share_path = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_ssh_port = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.num_shell_tries = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.nvmet_port_id = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.replication_device = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.report_discard_supported = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.reserved_percentage = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.scst_target_driver = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.storage_protocol = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.target_helper = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.target_ip_address = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.target_port = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.target_prefix = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.target_protocol = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.trace_flags = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.use_chap_auth = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_clear = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_clear_size = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] QuobyteHD.volumes_dir = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.ssl = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_notifications.driver = [] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_notifications.retry = -1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] key_manager.fixed_key = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.barbican_api_version = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.barbican_endpoint = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.barbican_endpoint_type = public {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.barbican_region_name = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.cafile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.collect_timing = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.insecure = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.number_of_retries = 60 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.retry_delay = 1 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.send_service_user_token = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.split_loggers = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.timeout = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.verify_ssl = True {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican.verify_ssl_path = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.auth_section = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.auth_type = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.cafile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.certfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.collect_timing = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.insecure = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.keyfile = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.split_loggers = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] barbican_service_user.timeout = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.approle_role_id = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.approle_secret_id = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.kv_mountpoint = secret {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.kv_path = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.kv_version = 2 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.namespace = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.root_token_id = **** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.ssl_ca_crt_file = None {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.timeout = 60.0 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.use_ssl = False {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 12:28:57 devstack cinder-volume[82972]: DEBUG oslo_service.backend._eventlet.service [None req-081b06d1-8f11-415a-b2a5-0068e1960db3 None None] ******************************************************************************** {{(pid=82972) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83114) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 12:28:57 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 12:28:57 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Running cmd (subprocess): mount.quobyte {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:57 devstack quobyte-client[83139]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 12:28:57 devstack quobyte-client[83139]: Invalid parameters found, error: missing mount point. Feb 27 12:28:57 devstack quobyte-client[83139]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 12:28:57 devstack quobyte-client[83139]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:57 devstack sudo[83147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:28:57 devstack sudo[83147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:58 devstack sudo[83147]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.390s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:58 devstack cinder-volume[83114]: INFO cinder.volume.driver [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Driver hasn't implemented _init_vendor_properties() Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.volume.driver [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83114) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_db.sqlalchemy.engines [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writer thread running {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.db.sqlalchemy.api [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Building query based on filter {{(pid=83114) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83114) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:58 devstack cinder-volume[83114]: INFO cinder.keymgr.migration [None req-40c01d22-0a63-4c90-984d-f9dc7fdaf738 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 12:28:58 devstack sudo[83181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:28:58 devstack sudo[83181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:58 devstack sudo[83181]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.403s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:28:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Driver initialization completed successfully. Feb 27 12:28:58 devstack cinder-volume[83114]: INFO cinder.manager [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Initiating service 3 cleanup Feb 27 12:28:58 devstack cinder-volume[83114]: INFO cinder.manager [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Service 3 cleanup completed. Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.service [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Creating RPC server for service cinder-volume {{(pid=83114) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.service [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83114) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 12:28:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:28:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:28:58 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:28:58 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:28:59 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Feb 27 12:28:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.442s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:28:59 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d7574411-9fd6-4aaf-ae05-63ac8b78f0ba None None] Driver post RPC initialization completed successfully. Feb 27 12:29:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-29ee4340-fb26-4f6f-8b43-bf85d1767e3a tempest-BackendsCapabilitiesAdminTestsJSON-1256657058 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83114) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 12:29:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-938c2b6a-0b3b-4bc5-8ee9-541ae3dc0073 tempest-BackendsCapabilitiesAdminTestsJSON-1256657058 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580642700195, 'free_capacity_gb': 1775.7580642700195, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83114) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 12:29:07 devstack cinder-volume[82972]: DEBUG dbcounter [-] [82972] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82972) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:29:08 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=2 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:29:09 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:29:54 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8d56c4b3-8bcc-47e0-afe3-9fa74c419bd7 tempest-GroupSnapshotsTest-976833075 None] Group tempest-GroupSnapshotsTest-Group-553014906: creating Feb 27 12:29:54 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8d56c4b3-8bcc-47e0-afe3-9fa74c419bd7 tempest-GroupSnapshotsTest-976833075 None] Group tempest-GroupSnapshotsTest-Group-553014906: created successfully Feb 27 12:29:54 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8d56c4b3-8bcc-47e0-afe3-9fa74c419bd7 tempest-GroupSnapshotsTest-976833075 None] Create group completed successfully. Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Flow 'volume_create_manager' (9302c3d5-6aa5-4a0c-b10a-344afe1355e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d403d508-4eaf-4677-8643-3c173e9d93ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d403d508-4eaf-4677-8643-3c173e9d93ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1423513626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d951edb-a166-4468-8c20-3c0d987ba47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5e4725bb34306911deae6bacf5bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:55Z,use_quota=True,user_id='069e21f6269846adbea60de2bdb8583e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d947b86-afc8-4697-b5e4-ea3b827ae084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d947b86-afc8-4697-b5e4-ea3b827ae084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c9894-f40a-4081-bbd8-bea23aa13cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6c9894-f40a-4081-bbd8-bea23aa13cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d951edb-a166-4468-8c20-3c0d987ba47d', 'volume_name': 'volume-1d951edb-a166-4468-8c20-3c0d987ba47d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9840fd2a-c1e9-4d5f-83c1-4d2faac79037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9840fd2a-c1e9-4d5f-83c1-4d2faac79037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c54504b-c938-46ce-9f6c-bab3d4257b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:54 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Volume 1d951edb-a166-4468-8c20-3c0d987ba47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d951edb-a166-4468-8c20-3c0d987ba47d', 'volume_size': 1} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1423513626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d951edb-a166-4468-8c20-3c0d987ba47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5e4725bb34306911deae6bacf5bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:55Z,use_quota=True,user_id='069e21f6269846adbea60de2bdb8583e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Creating volume 1d951edb-a166-4468-8c20-3c0d987ba47d {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:54 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:29:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:55 devstack sudo[83416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d 1073741824 Feb 27 12:29:55 devstack sudo[83416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (533a37bd-62f2-4943-a750-2647fbcd5e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a56b581-6a8d-4591-87ff-8746958e840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a56b581-6a8d-4591-87ff-8746958e840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191640222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77921d5f-1bc7-456d-be59-79854198b9d0,host='devstack@QuobyteHD#QuobyteHD',id=90c08706-d470-40a7-955b-4346080d0438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:56Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c20bb96c-71a7-4008-b1d1-741ce4ce3f97),volume_type_id=c20bb96c-71a7-4008-b1d1-741ce4ce3f97)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcbbb92-1dc3-4fb4-9fe1-1f78f10f9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcbbb92-1dc3-4fb4-9fe1-1f78f10f9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c70fd0e-57ec-40c7-bed4-87eaa745f2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c70fd0e-57ec-40c7-bed4-87eaa745f2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c08706-d470-40a7-955b-4346080d0438', 'volume_name': 'volume-90c08706-d470-40a7-955b-4346080d0438', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8312a8-60b0-4b16-89d2-18085b0fcebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8312a8-60b0-4b16-89d2-18085b0fcebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f8ebad-ccb5-4244-8690-45bd6b4f918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:55 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Volume 90c08706-d470-40a7-955b-4346080d0438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c08706-d470-40a7-955b-4346080d0438', 'volume_size': 1} Feb 27 12:29:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:56 devstack sudo[83416]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d 1073741824" returned: 0 in 1.159s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:56 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d Feb 27 12:29:56 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:56 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d" returned: 0 in 0.465s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77921d5f-1bc7-456d-be59-79854198b9d0,created_at=2026-02-27T11:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191640222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77921d5f-1bc7-456d-be59-79854198b9d0,host='devstack@QuobyteHD#QuobyteHD',id=90c08706-d470-40a7-955b-4346080d0438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:29:56Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c20bb96c-71a7-4008-b1d1-741ce4ce3f97),volume_type_id=c20bb96c-71a7-4008-b1d1-741ce4ce3f97)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Creating volume 90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:29:56 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c54504b-c938-46ce-9f6c-bab3d4257b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d951edb-a166-4468-8c20-3c0d987ba47d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d136fba-03ea-49a1-ac89-f5f13a7ac88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:56 devstack sudo[83738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 1073741824 Feb 27 12:29:56 devstack sudo[83738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:56 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Volume volume-1d951edb-a166-4468-8c20-3c0d987ba47d (1d951edb-a166-4468-8c20-3c0d987ba47d): created successfully Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d136fba-03ea-49a1-ac89-f5f13a7ac88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Flow 'volume_create_manager' (9302c3d5-6aa5-4a0c-b10a-344afe1355e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:56 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-45729572-367b-480a-a980-8a7d42ff5f5a tempest-VolumesAdminNegativeTest-98703208 None] Created volume successfully. Feb 27 12:29:57 devstack sudo[83738]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 1073741824" returned: 0 in 0.579s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:57 devstack sudo[83743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 Feb 27 12:29:57 devstack sudo[83743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Acquiring lock "cinder-1d951edb-a166-4468-8c20-3c0d987ba47d-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Lock "cinder-1d951edb-a166-4468-8c20-3c0d987ba47d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Acquiring lock "cinder-quobyte-1d951edb-a166-4468-8c20-3c0d987ba47d" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:29:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Lock "cinder-quobyte-1d951edb-a166-4468-8c20-3c0d987ba47d" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:29:57 devstack cinder-volume[83114]: INFO oslo.privsep.daemon [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdppru8xy/privsep.sock'] Feb 27 12:29:57 devstack sudo[83747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdppru8xy/privsep.sock Feb 27 12:29:57 devstack sudo[83747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:58 devstack sudo[83743]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438" returned: 0 in 0.825s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:29:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:29:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:29:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f8ebad-ccb5-4244-8690-45bd6b4f918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c08706-d470-40a7-955b-4346080d0438', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53198fe3-e870-49b3-9224-a45e7e051e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:29:58 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Volume volume-90c08706-d470-40a7-955b-4346080d0438 (90c08706-d470-40a7-955b-4346080d0438): created successfully Feb 27 12:29:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53198fe3-e870-49b3-9224-a45e7e051e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:29:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (533a37bd-62f2-4943-a750-2647fbcd5e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:29:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b3ccd22e-dc9d-4604-ac38-05acf48cbe6f tempest-GroupSnapshotsTest-976833075 None] Created volume successfully. Feb 27 12:29:59 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] GroupSnapshot 9ec6482e-ce71-4add-b467-13390a7e55f8: creating. Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Group snapshot 9ec6482e-ce71-4add-b467-13390a7e55f8: creating. {{(pid=83114) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:29:59 devstack sudo[83747]: pam_unix(sudo:session): session closed for user root Feb 27 12:29:59 devstack cinder-volume[83114]: INFO oslo.privsep.daemon [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Spawned new privsep daemon via rootwrap Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Accepted privsep connection to /tmp/tmpdppru8xy/privsep.sock {{(pid=83114) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 12:29:59 devstack cinder-volume[83114]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 12:29:59 devstack cinder-volume[83114]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 12:29:59 devstack cinder-volume[83114]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 12:29:59 devstack cinder-volume[83114]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83750 Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Creating offline snapshot 5f4061c7-79fc-42e5-8b2b-f95ab577b28f of volume 90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac85d1a9-20cb-4af3-99aa-bc0b1576813d]: (2,) {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:59 devstack cinder-volume[83114]: WARNING oslo_privsep.priv_context [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] privsep daemon already running: NotImplementedError Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf3e58b-d82e-4f62-9c06-42474bbe121a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae445ce-a4c8-467e-99b4-a1597b621293]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:29:59 devstack sudo[83753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d Feb 27 12:29:59 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:29:59 devstack sudo[83754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 Feb 27 12:29:59 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:00 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d" returned: 0 in 0.600s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:00 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d Feb 27 12:30:00 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:00 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438" returned: 0 in 1.029s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:00 devstack sudo[83765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f 1G Feb 27 12:30:00 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:01 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d951edb-a166-4468-8c20-3c0d987ba47d" returned: 0 in 0.859s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Lock "cinder-quobyte-1d951edb-a166-4468-8c20-3c0d987ba47d" released by "delete_volume" :: held 3.087s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:01 devstack cinder-volume[83114]: WARNING cinder.quota [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:01 devstack cinder-volume[83114]: WARNING cinder.quota [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Created reservations ['25dd3428-135e-4ea6-8b32-a53925c16319', '6b528453-53ee-4fc7-ba00-6f79b11829cc', 'e3119ae7-cd8e-448a-a5c8-d19fab64e970', '7c03aae3-ef39-4011-998e-c3533542086d'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:01 devstack sudo[83771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:01 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:01 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f 1G" returned: 0 in 0.834s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c08706-d470-40a7-955b-4346080d0438 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:01 devstack sudo[83773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c08706-d470-40a7-955b-4346080d0438 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f Feb 27 12:30:01 devstack sudo[83773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:01 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.622s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:01 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:01 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Deleted volume successfully. Feb 27 12:30:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d204768d-a39c-4c26-bd08-209d75c1ddea tempest-VolumesAdminNegativeTest-98703208 None] Lock "cinder-1d951edb-a166-4468-8c20-3c0d987ba47d-delete_volume" released by "delete_volume" :: held 4.183s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:02 devstack sudo[83773]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c08706-d470-40a7-955b-4346080d0438 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f" returned: 0 in 0.908s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:02 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:02 devstack sudo[83788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f Feb 27 12:30:02 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:03 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f" returned: 0 in 0.743s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:03 devstack sudo[83816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.info Feb 27 12:30:03 devstack sudo[83816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:03 devstack sudo[83816]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.info" returned: 0 in 0.658s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:03 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:03 devstack sudo[83833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.info Feb 27 12:30:03 devstack sudo[83833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:04 devstack sudo[83833]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.info" returned: 0 in 0.500s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.817s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Flow 'volume_create_manager' (d8fc5c7e-6d6a-4bb4-a26a-ba7877567473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4a80a-59f7-4139-9b9b-a5033a0448f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf4a80a-59f7-4139-9b9b-a5033a0448f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-560162385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0296324a-c2d5-47fa-a690-7bd25f2f816e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5f0d3481a14ba0a25e134f62d7cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:04Z,use_quota=True,user_id='0b60a4e3f83c4051a03116c9b2726eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21fee7-d777-42e6-ba2f-5e4cd9f7cb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e21fee7-d777-42e6-ba2f-5e4cd9f7cb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cbb4e4-1f56-4430-a9db-1f8e6a43c1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cbb4e4-1f56-4430-a9db-1f8e6a43c1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0296324a-c2d5-47fa-a690-7bd25f2f816e', 'volume_name': 'volume-0296324a-c2d5-47fa-a690-7bd25f2f816e', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea7063e-1fb3-46ad-9124-708d592b18f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea7063e-1fb3-46ad-9124-708d592b18f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbbebc6-400f-4b84-9a74-d9fb2a8a3aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:04 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Volume 0296324a-c2d5-47fa-a690-7bd25f2f816e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0296324a-c2d5-47fa-a690-7bd25f2f816e', 'volume_size': 1} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-560162385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0296324a-c2d5-47fa-a690-7bd25f2f816e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5f0d3481a14ba0a25e134f62d7cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:04Z,use_quota=True,user_id='0b60a4e3f83c4051a03116c9b2726eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Creating volume 0296324a-c2d5-47fa-a690-7bd25f2f816e {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:04 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:04 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-224a5a50-f07c-4c05-b458-b2fa403ac3a4 tempest-GroupSnapshotsTest-976833075 None] group_snapshot 9ec6482e-ce71-4add-b467-13390a7e55f8: created successfully Feb 27 12:30:04 devstack sudo[83869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e 1073741824 Feb 27 12:30:04 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:05 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e 1073741824" returned: 0 in 0.570s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:05 devstack sudo[83876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e Feb 27 12:30:05 devstack sudo[83876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:05 devstack sudo[83876]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e" returned: 0 in 0.444s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbbebc6-400f-4b84-9a74-d9fb2a8a3aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0296324a-c2d5-47fa-a690-7bd25f2f816e', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ba7f75-5c16-4266-82cd-895eddef0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:05 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Volume volume-0296324a-c2d5-47fa-a690-7bd25f2f816e (0296324a-c2d5-47fa-a690-7bd25f2f816e): created successfully Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ba7f75-5c16-4266-82cd-895eddef0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Flow 'volume_create_manager' (d8fc5c7e-6d6a-4bb4-a26a-ba7877567473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:05 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d420de84-76e4-45ad-ab14-6e999ea28cfa tempest-VolumeQuotasAdminTestJSON-1856422159 None] Created volume successfully. Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-5f4061c7-79fc-42e5-8b2b-f95ab577b28f-71d703cb-d4b1-4291-b495-cb1ba349e09a" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-5f4061c7-79fc-42e5-8b2b-f95ab577b28f-71d703cb-d4b1-4291-b495-cb1ba349e09a" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Creating volume 71d703cb-d4b1-4291-b495-cb1ba349e09a from snapshot 5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-71d703cb-d4b1-4291-b495-cb1ba349e09a" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-71d703cb-d4b1-4291-b495-cb1ba349e09a" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] snapshot: 5f4061c7-79fc-42e5-8b2b-f95ab577b28f, volume: 71d703cb-d4b1-4291-b495-cb1ba349e09a, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4027d3c3-5f0d-407f-b8b2-c791c989747e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:05 devstack sudo[83880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f Feb 27 12:30:05 devstack sudo[83880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:06 devstack sudo[83880]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f" returned: 0 in 0.542s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c08706-d470-40a7-955b-4346080d0438(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077004f-8ee5-43f8-b157-8d3e6d162a90]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:06 devstack sudo[83885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 Feb 27 12:30:06 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Acquiring lock "cinder-0296324a-c2d5-47fa-a690-7bd25f2f816e-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "cinder-0296324a-c2d5-47fa-a690-7bd25f2f816e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Acquiring lock "cinder-quobyte-0296324a-c2d5-47fa-a690-7bd25f2f816e" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "cinder-quobyte-0296324a-c2d5-47fa-a690-7bd25f2f816e" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2ac0a-eefd-43dd-abed-5be863088c74]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:06 devstack sudo[83888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e Feb 27 12:30:06 devstack sudo[83888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:06 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:30:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:06 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a Feb 27 12:30:06 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:07 devstack sudo[83888]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e" returned: 0 in 0.548s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:07 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e Feb 27 12:30:07 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:07 devstack sudo[83903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:07 devstack sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:08 devstack sudo[83903]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 1.106s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:08 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0296324a-c2d5-47fa-a690-7bd25f2f816e" returned: 0 in 1.266s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "cinder-quobyte-0296324a-c2d5-47fa-a690-7bd25f2f816e" released by "delete_volume" :: held 1.850s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Created reservations ['1b9eadfc-d314-431f-915c-3605edd247b7', '9adc0608-96a1-4d62-8663-730915afc454', '42c2a51b-3213-4e60-82ce-b67a92095271', '8da66a7c-c754-45b2-be00-85d6399a3012'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:08 devstack sudo[83930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:08 devstack sudo[83930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:09 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a" returned: 0 in 2.960s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b9b92b-a28e-4ebd-8610-d2ecff330bca]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:09 devstack sudo[83930]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 1.058s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Deleted volume successfully. Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5c23aad5-399f-4c77-ae28-afbcc94fc0bf tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "cinder-0296324a-c2d5-47fa-a690-7bd25f2f816e-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Flow 'volume_create_manager' (6d34a5a4-b571-4b51-8c02-d74b8ad96535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fedf25d-fe64-4bd1-bb5f-e2068025ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fedf25d-fe64-4bd1-bb5f-e2068025ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1702318578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f45e7-694e-419d-aee6-4567d394965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5f0d3481a14ba0a25e134f62d7cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:10Z,use_quota=True,user_id='0b60a4e3f83c4051a03116c9b2726eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c1a11c-4bda-4628-8b77-36f75e4fbc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack sudo[83933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 Feb 27 12:30:09 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c1a11c-4bda-4628-8b77-36f75e4fbc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67868a2-1c88-4310-85cd-a6a3f1e7a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67868a2-1c88-4310-85cd-a6a3f1e7a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936f45e7-694e-419d-aee6-4567d394965f', 'volume_name': 'volume-936f45e7-694e-419d-aee6-4567d394965f', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce976a0-b122-491c-8603-0ffc1bdbd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce976a0-b122-491c-8603-0ffc1bdbd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c40a87-31f9-447a-98b6-a0c7c78fc7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:10 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Volume 936f45e7-694e-419d-aee6-4567d394965f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936f45e7-694e-419d-aee6-4567d394965f', 'volume_size': 1} Feb 27 12:30:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:10 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438" returned: 0 in 0.703s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:10 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438, size 1024.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:30:10 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Converted 1024.00 MB image at 345.85 MB/s Feb 27 12:30:10 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:10 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a Feb 27 12:30:10 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:11 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a" returned: 0 in 0.584s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-71d703cb-d4b1-4291-b495-cb1ba349e09a" released by "_copy_volume_from_snapshot" :: held 5.384s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-5f4061c7-79fc-42e5-8b2b-f95ab577b28f-71d703cb-d4b1-4291-b495-cb1ba349e09a" released by "_create_volume_from_snapshot" :: held 5.403s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.411s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1702318578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f45e7-694e-419d-aee6-4567d394965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5f0d3481a14ba0a25e134f62d7cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:10Z,use_quota=True,user_id='0b60a4e3f83c4051a03116c9b2726eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Creating volume 936f45e7-694e-419d-aee6-4567d394965f {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:11 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:11 devstack sudo[83957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f 1073741824 Feb 27 12:30:11 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f99953e3-f9c3-4d3c-a311-63636a9255b7 tempest-GroupSnapshotsTest-976833075 None] Create group from source-snapshot-9ec6482e-ce71-4add-b467-13390a7e55f8 completed successfully. Feb 27 12:30:11 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f 1073741824" returned: 0 in 0.590s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:11 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f Feb 27 12:30:11 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:12 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-71d703cb-d4b1-4291-b495-cb1ba349e09a" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f" returned: 0 in 0.470s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c40a87-31f9-447a-98b6-a0c7c78fc7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936f45e7-694e-419d-aee6-4567d394965f', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df0234b-509b-4d9b-8877-d90ea36cd6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-71d703cb-d4b1-4291-b495-cb1ba349e09a" acquired by "delete_volume" :: waited 0.031s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:12 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Volume volume-936f45e7-694e-419d-aee6-4567d394965f (936f45e7-694e-419d-aee6-4567d394965f): created successfully Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df0234b-509b-4d9b-8877-d90ea36cd6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Flow 'volume_create_manager' (6d34a5a4-b571-4b51-8c02-d74b8ad96535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d95686-f9ea-4a9a-896c-d17179ddfadf]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4a47b13b-9929-4724-86b9-5cfb86ef574e tempest-VolumeQuotasAdminTestJSON-1856422159 None] Created volume successfully. Feb 27 12:30:12 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a Feb 27 12:30:12 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:12 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a" returned: 0 in 0.594s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:12 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a Feb 27 12:30:12 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:13 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-71d703cb-d4b1-4291-b495-cb1ba349e09a" returned: 0 in 0.521s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-71d703cb-d4b1-4291-b495-cb1ba349e09a" released by "delete_volume" :: held 1.148s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Created reservations ['e27176b5-e22e-4c0a-8abb-f608086887e3'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:13 devstack cinder-volume[83114]: WARNING cinder.quota [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-549374213 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-549374213, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:13 devstack cinder-volume[83114]: WARNING cinder.quota [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-549374213 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-549374213, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Created reservations ['82bc9304-8e19-42ba-9771-d7bdca981989', 'f396a3e5-0728-43c5-a355-2eca1ce1747b', '6878a05c-084e-4e22-a668-262362e574ab', 'fa35aa1a-1549-4739-9212-2e5eefeb43f7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:13 devstack sudo[83976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:13 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:13 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-77165cf8-64c3-4d2f-9368-8eba78f1a2f8 tempest-VolumeQuotasAdminTestJSON-274325352 None] Transfer volume completed successfully. Feb 27 12:30:14 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.536s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1fd3d177-64e5-4304-8372-a0770a4f3b99 tempest-GroupSnapshotsTest-976833075 None] Delete group completed successfully. Feb 27 12:30:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] group_snapshot 9ec6482e-ce71-4add-b467-13390a7e55f8: deleting Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] group_snapshot 9ec6482e-ce71-4add-b467-13390a7e55f8: deleting {{(pid=83114) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-90c08706-d470-40a7-955b-4346080d0438" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-90c08706-d470-40a7-955b-4346080d0438" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-5f4061c7-79fc-42e5-8b2b-f95ab577b28f" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-5f4061c7-79fc-42e5-8b2b-f95ab577b28f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Deleting offline snapshot 5f4061c7-79fc-42e5-8b2b-f95ab577b28f of volume 90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] snapshot_file for this snap is: volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e50219-c3eb-44c4-9fde-32a94f483238]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:14 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f Feb 27 12:30:14 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Acquiring lock "cinder-936f45e7-694e-419d-aee6-4567d394965f-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Lock "cinder-936f45e7-694e-419d-aee6-4567d394965f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Acquiring lock "cinder-quobyte-936f45e7-694e-419d-aee6-4567d394965f" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Lock "cinder-quobyte-936f45e7-694e-419d-aee6-4567d394965f" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e00ccc-99db-48d8-affb-8ea315859be0]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:14 devstack sudo[83988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f Feb 27 12:30:14 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:15 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f" returned: 0 in 0.581s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c08706-d470-40a7-955b-4346080d0438(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5e7c42-cac9-403e-81d7-863e3c2a9ebd]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:15 devstack sudo[83993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 Feb 27 12:30:15 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:15 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f" returned: 0 in 0.573s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:15 devstack sudo[83999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f Feb 27 12:30:15 devstack sudo[83999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:15 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438" returned: 0 in 0.550s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:15 devstack sudo[84005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f Feb 27 12:30:15 devstack sudo[84005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:15 devstack sudo[83999]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-936f45e7-694e-419d-aee6-4567d394965f" returned: 0 in 0.431s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Lock "cinder-quobyte-936f45e7-694e-419d-aee6-4567d394965f" released by "delete_volume" :: held 1.041s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Created reservations ['d08dd17f-9a89-4cd4-9f7f-f10a07bfa8e8', '8ff8f3b0-4fa5-4037-843c-6ee5d8cc9903', '5ca3c5f3-ec1c-49f2-8c28-d8efbb19a854', '05c0d6fc-15ba-4ebf-8f7b-fe8d1946f1ad'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:16 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:16 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:16 devstack sudo[84005]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f" returned: 0 in 0.901s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:16 devstack sudo[84039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f Feb 27 12:30:16 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:16 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.818s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:16 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:16 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Deleted volume successfully. Feb 27 12:30:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-585b09c6-ba9c-45c3-b4ff-168211950d18 tempest-VolumeQuotasAdminTestJSON-1805604531 None] Lock "cinder-936f45e7-694e-419d-aee6-4567d394965f-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:17 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438.5f4061c7-79fc-42e5-8b2b-f95ab577b28f" returned: 0 in 0.687s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-5f4061c7-79fc-42e5-8b2b-f95ab577b28f" released by "_delete_snapshot" :: held 2.798s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-90c08706-d470-40a7-955b-4346080d0438" released by "delete_snapshot" :: held 2.814s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:17 devstack cinder-volume[83114]: WARNING cinder.quota [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-549374213 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-549374213, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:17 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] Created reservations ['10ce64d7-dc72-4f78-bf24-13d2113f4962', '9b125c88-0263-474b-ac97-6ffc2370f40f', '255a4e15-1661-417a-a19e-d8c887b6b22a', '1c970ba9-3ab0-497c-be27-a28d6a6efae9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:17 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-dad1fb71-dcd8-474c-9fbd-8bfe690489c9 tempest-GroupSnapshotsTest-976833075 None] group_snapshot 9ec6482e-ce71-4add-b467-13390a7e55f8: deleted successfully Feb 27 12:30:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-90c08706-d470-40a7-955b-4346080d0438" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-90c08706-d470-40a7-955b-4346080d0438" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:18 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd271d-fee4-43b0-a2a2-b1a89d2acb87]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:18 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 Feb 27 12:30:18 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:18 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438" returned: 0 in 0.666s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:18 devstack sudo[84050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438 Feb 27 12:30:18 devstack sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:19 devstack sudo[84050]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-90c08706-d470-40a7-955b-4346080d0438" returned: 0 in 0.844s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-90c08706-d470-40a7-955b-4346080d0438" released by "delete_volume" :: held 1.560s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Created reservations ['74962a1a-3223-4baf-a91b-d041dacfd1df'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:19 devstack cinder-volume[83114]: WARNING cinder.db.sqlalchemy.api [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-549374213'] Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Created reservations ['e5761a85-f6ef-43a9-9052-44de8538dd97', '00648d17-2653-45f0-a213-a81455b24792', '36550616-31bd-4a19-a993-09f959fae885', '46d9843d-413e-4035-9ec9-d1f5ff35deb4'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Flow 'volume_create_manager' (31fb1ca3-78b8-43af-bb94-f7c173fd2e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4c4637-4dbf-460f-b924-8f4f902395c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4c4637-4dbf-460f-b924-8f4f902395c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1115530926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5872dc-1524-46d0-b92b-d148170b5a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31e14908b734afdbf2e9b1858ef1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:20Z,use_quota=True,user_id='3ae337a14fb9484e88db9bd338bb3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ac0920-0c0d-4360-8899-669da5e69427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ac0920-0c0d-4360-8899-669da5e69427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973a5b7f-61f3-4445-825a-e04473fc207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973a5b7f-61f3-4445-825a-e04473fc207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5872dc-1524-46d0-b92b-d148170b5a20', 'volume_name': 'volume-af5872dc-1524-46d0-b92b-d148170b5a20', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbff29a-6ea3-4d81-a000-445a5871de28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbff29a-6ea3-4d81-a000-445a5871de28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbe40b0-4634-4c6d-827a-8ba648535654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Volume af5872dc-1524-46d0-b92b-d148170b5a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5872dc-1524-46d0-b92b-d148170b5a20', 'volume_size': 1} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1115530926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5872dc-1524-46d0-b92b-d148170b5a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31e14908b734afdbf2e9b1858ef1178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:20Z,use_quota=True,user_id='3ae337a14fb9484e88db9bd338bb3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Creating volume af5872dc-1524-46d0-b92b-d148170b5a20 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:19 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:19 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 1073741824 Feb 27 12:30:19 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:20 devstack sudo[84056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:20 devstack sudo[84056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:20 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 1073741824" returned: 0 in 0.794s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:20 devstack sudo[84056]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.750s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:20 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:20 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-10c0144b-c573-405c-a907-4e03086ada19 tempest-GroupSnapshotsTest-976833075 None] Delete group completed successfully. Feb 27 12:30:20 devstack sudo[84062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 Feb 27 12:30:20 devstack sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3562d72f-fca8-4dca-bed9-f5fd3842f435 tempest-GroupSnapshotsTest-976833075 None] Group tempest-GroupSnapshotsTest-Group-1074801484: creating Feb 27 12:30:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3562d72f-fca8-4dca-bed9-f5fd3842f435 tempest-GroupSnapshotsTest-976833075 None] Group tempest-GroupSnapshotsTest-Group-1074801484: created successfully Feb 27 12:30:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3562d72f-fca8-4dca-bed9-f5fd3842f435 tempest-GroupSnapshotsTest-976833075 None] Create group completed successfully. Feb 27 12:30:21 devstack sudo[84062]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20" returned: 0 in 0.794s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbe40b0-4634-4c6d-827a-8ba648535654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5872dc-1524-46d0-b92b-d148170b5a20', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358fc1c1-a351-4afe-ba9e-a8596a18f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Volume volume-af5872dc-1524-46d0-b92b-d148170b5a20 (af5872dc-1524-46d0-b92b-d148170b5a20): created successfully Feb 27 12:30:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358fc1c1-a351-4afe-ba9e-a8596a18f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Flow 'volume_create_manager' (31fb1ca3-78b8-43af-bb94-f7c173fd2e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b1e6be1c-5ec4-43ab-af24-ab37b43b493f tempest-DeleteServersTestJSON-656406751 None] Created volume successfully. Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (3b31eda3-4493-4af4-b4ef-582869455c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e26d25-3553-4908-9b17-824066ca0c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e26d25-3553-4908-9b17-824066ca0c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990073096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c9cf0f0-1e73-4b87-982a-a094486f43ed,host='devstack@QuobyteHD#QuobyteHD',id=8b23805f-ee94-45b8-b1b7-d53849b3a2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:23Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cd32f73-0e54-4cfb-9350-03e57f592cc7),volume_type_id=6cd32f73-0e54-4cfb-9350-03e57f592cc7)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e1616c-66d7-4060-87b0-3102eb93511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e1616c-66d7-4060-87b0-3102eb93511b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f2b71-09e8-4780-b2fd-64fe768abe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0f2b71-09e8-4780-b2fd-64fe768abe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b23805f-ee94-45b8-b1b7-d53849b3a2ae', 'volume_name': 'volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3056ad-bed9-4f4b-b0e3-ed08708ff2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3056ad-bed9-4f4b-b0e3-ed08708ff2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b0dc3e-1b40-404c-997d-f2653070964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:22 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Volume 8b23805f-ee94-45b8-b1b7-d53849b3a2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae', 'volume_size': 1} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c9cf0f0-1e73-4b87-982a-a094486f43ed,created_at=2026-02-27T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-990073096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c9cf0f0-1e73-4b87-982a-a094486f43ed,host='devstack@QuobyteHD#QuobyteHD',id=8b23805f-ee94-45b8-b1b7-d53849b3a2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:23Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cd32f73-0e54-4cfb-9350-03e57f592cc7),volume_type_id=6cd32f73-0e54-4cfb-9350-03e57f592cc7)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Creating volume 8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:23 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:23 devstack sudo[84068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae 1073741824 Feb 27 12:30:23 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:23 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae 1073741824" returned: 0 in 0.802s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:23 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae Feb 27 12:30:23 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Flow 'volume_create_manager' (c5675e07-217d-4a5c-9040-ab3f5a5c8ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a316b10-5d3e-426a-b869-a2103fb6a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a316b10-5d3e-426a-b869-a2103fb6a072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1607679103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fc9677-8c8b-4070-bc53-2f4a3f97b5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b3ebaa09ee4ddfa924476b2cf09a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:24Z,use_quota=True,user_id='655c1d747c1c45f686e4a2afe643b5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71603899-48b1-4946-9cce-13b6b0a79c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71603899-48b1-4946-9cce-13b6b0a79c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5256f604-0745-4ab3-838f-ab913a903475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5256f604-0745-4ab3-838f-ab913a903475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38fc9677-8c8b-4070-bc53-2f4a3f97b5bf', 'volume_name': 'volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a7c24d-e29a-4f00-97a4-0e3608953eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a7c24d-e29a-4f00-97a4-0e3608953eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a080524b-ca6f-4b07-a2e2-412292b5b46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:24 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Volume 38fc9677-8c8b-4070-bc53-2f4a3f97b5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf', 'volume_size': 1} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:24 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" returned: 0 in 0.627s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1607679103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fc9677-8c8b-4070-bc53-2f4a3f97b5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b3ebaa09ee4ddfa924476b2cf09a84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:24Z,use_quota=True,user_id='655c1d747c1c45f686e4a2afe643b5b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Creating volume 38fc9677-8c8b-4070-bc53-2f4a3f97b5bf {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:24 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b0dc3e-1b40-404c-997d-f2653070964f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3264e5-8000-4666-87bc-4eb48ae595a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:24 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Volume volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae (8b23805f-ee94-45b8-b1b7-d53849b3a2ae): created successfully Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3264e5-8000-4666-87bc-4eb48ae595a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (3b31eda3-4493-4af4-b4ef-582869455c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:24 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf 1073741824 Feb 27 12:30:24 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:24 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-7b85a0d3-6f0d-414e-a883-40e98416a2b2 tempest-GroupSnapshotsTest-976833075 None] Created volume successfully. Feb 27 12:30:25 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf 1073741824" returned: 0 in 0.723s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:25 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf Feb 27 12:30:25 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (9d65afca-0a94-4288-bb28-49743b9d90dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:25 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b26e3d-1950-4a54-b4ab-91c54339c48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf" returned: 0 in 0.733s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b26e3d-1950-4a54-b4ab-91c54339c48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848636259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c9cf0f0-1e73-4b87-982a-a094486f43ed,host='devstack@QuobyteHD#QuobyteHD',id=8dbfbf23-e029-4ff8-aab3-79bbbb1b5560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:26Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cd32f73-0e54-4cfb-9350-03e57f592cc7),volume_type_id=6cd32f73-0e54-4cfb-9350-03e57f592cc7)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbdf857-ccc0-4f4f-8e62-f3936498727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbdf857-ccc0-4f4f-8e62-f3936498727f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8756e40-8131-4493-aaf5-68eeffe93ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8756e40-8131-4493-aaf5-68eeffe93ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbfbf23-e029-4ff8-aab3-79bbbb1b5560', 'volume_name': 'volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9d0261-c4e8-4486-aa74-9ca5c60140d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9d0261-c4e8-4486-aa74-9ca5c60140d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b241ff7d-de66-4460-9eed-cac2c5d366bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Volume 8dbfbf23-e029-4ff8-aab3-79bbbb1b5560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560', 'volume_size': 1} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c9cf0f0-1e73-4b87-982a-a094486f43ed,created_at=2026-02-27T11:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848636259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c9cf0f0-1e73-4b87-982a-a094486f43ed,host='devstack@QuobyteHD#QuobyteHD',id=8dbfbf23-e029-4ff8-aab3-79bbbb1b5560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:26Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cd32f73-0e54-4cfb-9350-03e57f592cc7),volume_type_id=6cd32f73-0e54-4cfb-9350-03e57f592cc7)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Creating volume 8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:26 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a080524b-ca6f-4b07-a2e2-412292b5b46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7109f-cd07-449a-a45e-1bb97aa54461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:26 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Volume volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf (38fc9677-8c8b-4070-bc53-2f4a3f97b5bf): created successfully Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd7109f-cd07-449a-a45e-1bb97aa54461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Flow 'volume_create_manager' (c5675e07-217d-4a5c-9040-ab3f5a5c8ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:26 devstack sudo[84088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 1073741824 Feb 27 12:30:26 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:26 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e201ba67-4b80-4cb3-830a-3379e8518624 tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Created volume successfully. Feb 27 12:30:27 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 1073741824" returned: 0 in 0.999s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:27 devstack sudo[84094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 Feb 27 12:30:27 devstack sudo[84094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Acquiring lock "cinder-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "cinder-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Acquiring lock "cinder-quobyte-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "cinder-quobyte-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf" acquired by "delete_volume" :: waited 0.046s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7808849-0c73-49d9-af65-754c4fffdffa]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:27 devstack cinder-volume[83114]: WARNING py.warnings [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 27 12:30:27 devstack cinder-volume[83114]: .first() Feb 27 12:30:27 devstack cinder-volume[83114]: Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:27 devstack sudo[84094]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" returned: 0 in 0.781s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.050s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:27 devstack sudo[84107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b241ff7d-de66-4460-9eed-cac2c5d366bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb940c5-b613-4230-97e9-fd3604865e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3808a64f-2283-4d8e-a185-e219434308cc]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:27 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:27 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Volume volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 (8dbfbf23-e029-4ff8-aab3-79bbbb1b5560): created successfully Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb940c5-b613-4230-97e9-fd3604865e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (9d65afca-0a94-4288-bb28-49743b9d90dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:27 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-fd193d91-08a4-4684-bdcc-79a24c52e8d5 tempest-GroupSnapshotsTest-976833075 None] Created volume successfully. Feb 27 12:30:27 devstack sudo[84109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 Feb 27 12:30:27 devstack sudo[84109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:28 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf" returned: 0 in 0.755s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:28 devstack sudo[84109]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20" returned: 0 in 0.560s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.583s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:28 devstack sudo[84117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf Feb 27 12:30:28 devstack sudo[84117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769', 'name': 'volume-af5872dc-1524-46d0-b92b-d148170b5a20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '505010ba-7638-490d-8de4-2ea4c47d7d12', 'enforce_multipath': True} {{(pid=83114) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 12:30:28 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-d6e8c256-3869-4b71-963c-0bdc88da7d0c req-a87f4d76-a7f8-44ff-affd-67e04ba645db tempest-DeleteServersTestJSON-656406751 None] attachment_update completed successfully. Feb 27 12:30:28 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b73b05aa-5a08-433b-8036-6f8836b6e1e4 tempest-GroupSnapshotsTest-976833075 None] Update group completed successfully. Feb 27 12:30:29 devstack sudo[84117]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf" returned: 0 in 0.660s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "cinder-quobyte-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf" released by "delete_volume" :: held 1.489s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Created reservations ['72eb0c4e-e0b9-4121-92ac-87e0e0f73744', 'a14f4506-3a1a-487d-a3f2-e5415a958adf', '5e345030-1682-4dce-a091-160ac4537c76', 'ed54efb3-1ec4-43e1-a5ac-e54180cb2cb5'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:29 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:29 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:29 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Deleted volume successfully. Feb 27 12:30:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cb8f179-f9c4-49ab-a782-fd5809436e3a tempest-VolumeQuotasNegativeTestJSON-2107658173 None] Lock "cinder-38fc9677-8c8b-4070-bc53-2f4a3f97b5bf-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-566c25a7-2fae-46cc-b984-cddfad955793 tempest-GroupSnapshotsTest-976833075 None] Update group completed successfully. Feb 27 12:30:31 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-bdcc81b1-a1e2-4149-99a7-2833f8707937 tempest-GroupSnapshotsTest-976833075 None] Update group completed successfully. Feb 27 12:30:32 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e4fb5a83-aad2-4707-877e-61b60fa99c83 tempest-GroupSnapshotsTest-976833075 None] Update group completed successfully. Feb 27 12:30:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] GroupSnapshot ff7a419a-9341-4653-ab66-582ff531e26a: creating. Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Group snapshot ff7a419a-9341-4653-ab66-582ff531e26a: creating. {{(pid=83114) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Creating offline snapshot 57e69247-5068-4180-9cad-cf08d21adf63 of volume 8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe1ccf4-a264-4863-befa-33d4ba18f6fd]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:34 devstack sudo[84508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 Feb 27 12:30:34 devstack sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:34 devstack sudo[84508]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" returned: 0 in 0.671s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:34 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 1G Feb 27 12:30:34 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:35 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 1G" returned: 0 in 0.632s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:35 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 Feb 27 12:30:35 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:36 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63" returned: 0 in 0.541s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:36 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:36 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 Feb 27 12:30:36 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:36 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63" returned: 0 in 0.499s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:36 devstack sudo[84579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.info Feb 27 12:30:36 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:37 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.info" returned: 0 in 0.581s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:37 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:37 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.info Feb 27 12:30:37 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-f2310888-e092-46a8-918e-55dcca74b036 req-0799ddba-9a27-4870-b565-213648eeead2 tempest-DeleteServersTestJSON-656406751 None] Terminate volume connection completed successfully. Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-f2310888-e092-46a8-918e-55dcca74b036 req-0799ddba-9a27-4870-b565-213648eeead2 tempest-DeleteServersTestJSON-656406751 None] Deleting attachment 505010ba-7638-490d-8de4-2ea4c47d7d12. {{(pid=83114) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 12:30:37 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.info" returned: 0 in 0.588s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.579s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Creating offline snapshot e4a89387-e990-4762-8289-8adda9d8503a of volume 8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9515f36-80f7-4eeb-86db-40e100e6807e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:37 devstack sudo[84586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae Feb 27 12:30:37 devstack sudo[84586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:38 devstack sudo[84586]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" returned: 0 in 0.555s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:38 devstack sudo[84591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a 1G Feb 27 12:30:38 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:39 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a 1G" returned: 0 in 0.693s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:39 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a Feb 27 12:30:39 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:39 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a" returned: 0 in 0.537s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:39 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:39 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a Feb 27 12:30:39 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Flow 'volume_create_manager' (ab847cb6-5e51-4171-a399-0208496b10d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d01a86-2823-4576-8a32-a05c53512ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d01a86-2823-4576-8a32-a05c53512ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2038813001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b10021-755a-4a11-b285-da928f4dea16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515b7a73fd924720b489e4e57b388e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:40Z,use_quota=True,user_id='73dba9bb481f4bbdb461eadba47af180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa745a3-87e0-4c47-91de-96a6af0947e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa745a3-87e0-4c47-91de-96a6af0947e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61b07c7-30ba-4b03-9fbd-f579834e74db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61b07c7-30ba-4b03-9fbd-f579834e74db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b10021-755a-4a11-b285-da928f4dea16', 'volume_name': 'volume-72b10021-755a-4a11-b285-da928f4dea16', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5089afc8-560a-4a73-9d79-649a4ea74720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5089afc8-560a-4a73-9d79-649a4ea74720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041a7e97-594b-4003-80ee-d0da8431fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:39 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Volume 72b10021-755a-4a11-b285-da928f4dea16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b10021-755a-4a11-b285-da928f4dea16', 'volume_size': 1} Feb 27 12:30:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:40 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:40 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.info Feb 27 12:30:40 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:40 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.info" returned: 0 in 0.413s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:40 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:40 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.info Feb 27 12:30:40 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:40 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.info" returned: 0 in 0.396s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2038813001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b10021-755a-4a11-b285-da928f4dea16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515b7a73fd924720b489e4e57b388e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:40Z,use_quota=True,user_id='73dba9bb481f4bbdb461eadba47af180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Creating volume 72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:40 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:40 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 1073741824 Feb 27 12:30:40 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-38571799-cf73-4dba-a4ab-0765810e8e7e tempest-GroupSnapshotsTest-976833075 None] group_snapshot ff7a419a-9341-4653-ab66-582ff531e26a: created successfully Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Acquiring lock "cinder-af5872dc-1524-46d0-b92b-d148170b5a20-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Lock "cinder-af5872dc-1524-46d0-b92b-d148170b5a20-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Acquiring lock "cinder-quobyte-af5872dc-1524-46d0-b92b-d148170b5a20" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Lock "cinder-quobyte-af5872dc-1524-46d0-b92b-d148170b5a20" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ec671e-943c-4cc4-93c8-0e6a1401ab3e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:41 devstack sudo[84615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 Feb 27 12:30:41 devstack sudo[84615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:41 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 1073741824" returned: 0 in 0.590s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:41 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 Feb 27 12:30:41 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:41 devstack sudo[84615]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] group_snapshot ff7a419a-9341-4653-ab66-582ff531e26a: deleting Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20" returned: 0 in 0.525s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] group_snapshot ff7a419a-9341-4653-ab66-582ff531e26a: deleting {{(pid=83114) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:30:41 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20 Feb 27 12:30:41 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-57e69247-5068-4180-9cad-cf08d21adf63" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-57e69247-5068-4180-9cad-cf08d21adf63" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Deleting offline snapshot 57e69247-5068-4180-9cad-cf08d21adf63 of volume 8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] snapshot_file for this snap is: volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b034ebd-291f-4a9b-84f9-6cd9947e3d0d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:41 devstack sudo[84627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 Feb 27 12:30:41 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:42 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16" returned: 0 in 0.517s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041a7e97-594b-4003-80ee-d0da8431fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b10021-755a-4a11-b285-da928f4dea16', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5dce29-8421-4ec5-9d2c-8358de5b57d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:42 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Volume volume-72b10021-755a-4a11-b285-da928f4dea16 (72b10021-755a-4a11-b285-da928f4dea16): created successfully Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5dce29-8421-4ec5-9d2c-8358de5b57d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Flow 'volume_create_manager' (ab847cb6-5e51-4171-a399-0208496b10d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-20538ffd-6132-400b-bbb9-31d7014b0f74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Created volume successfully. Feb 27 12:30:42 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af5872dc-1524-46d0-b92b-d148170b5a20" returned: 0 in 0.517s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Lock "cinder-quobyte-af5872dc-1524-46d0-b92b-d148170b5a20" released by "delete_volume" :: held 1.066s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Created reservations ['a01ebf45-c01a-425a-b325-e863ca767d82', 'f9f1146e-2a13-45f3-a3ba-56de9046614a', '5e413663-e7e8-41e8-8edc-b0d0f6c7038a', 'bbf4f7c4-7da5-4286-bccb-094a90df94df'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:42 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63" returned: 0 in 0.549s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:42 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:42 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[88264d86-0b92-4eeb-a621-6bbcb2a23e21]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:42 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 Feb 27 12:30:42 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:42 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.400s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Deleted volume successfully. Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a2f4cedb-d856-46e8-bb28-9db5eee9131f tempest-DeleteServersTestJSON-656406751 None] Lock "cinder-af5872dc-1524-46d0-b92b-d148170b5a20-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:42 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" returned: 0 in 0.517s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:42 devstack sudo[84642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 Feb 27 12:30:42 devstack sudo[84642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Creating offline snapshot 518d2040-d3a7-4c8f-8f3c-0e0e23395d98 of volume 72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd7d1a6-698a-4db0-9fbe-52673bf63d97]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:43 devstack sudo[84646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 Feb 27 12:30:43 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack sudo[84642]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63" returned: 0 in 0.606s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:43 devstack sudo[84649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63 Feb 27 12:30:43 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16" returned: 0 in 0.581s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:43 devstack sudo[84654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 1G Feb 27 12:30:43 devstack sudo[84654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:43 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560.57e69247-5068-4180-9cad-cf08d21adf63" returned: 0 in 0.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-57e69247-5068-4180-9cad-cf08d21adf63" released by "_delete_snapshot" :: held 2.285s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" released by "delete_snapshot" :: held 2.297s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-e4a89387-e990-4762-8289-8adda9d8503a" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-e4a89387-e990-4762-8289-8adda9d8503a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Deleting offline snapshot e4a89387-e990-4762-8289-8adda9d8503a of volume 8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] snapshot_file for this snap is: volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c28b93-9c3b-4c41-aa69-9daa6f26a706]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:44 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a Feb 27 12:30:44 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:44 devstack sudo[84654]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 1G" returned: 0 in 0.633s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b10021-755a-4a11-b285-da928f4dea16 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:44 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b10021-755a-4a11-b285-da928f4dea16 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 Feb 27 12:30:44 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:44 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a" returned: 0 in 0.617s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5e82c-5a2a-43b6-adb6-848410ccc9a2]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:44 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae Feb 27 12:30:44 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:45 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72b10021-755a-4a11-b285-da928f4dea16 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98" returned: 0 in 0.667s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:45 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 is being set with open permissions: ugo+rw Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:45 devstack sudo[84674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 Feb 27 12:30:45 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:45 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" returned: 0 in 0.609s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:45 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a Feb 27 12:30:45 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:45 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98" returned: 0 in 0.546s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:45 devstack sudo[84692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.info Feb 27 12:30:45 devstack sudo[84692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:45 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a" returned: 0 in 0.581s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:45 devstack sudo[84702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a Feb 27 12:30:45 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:46 devstack sudo[84692]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.info" returned: 0 in 0.582s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:46 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.info is being set with open permissions: ugo+rw Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:46 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.info Feb 27 12:30:46 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:46 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae.e4a89387-e990-4762-8289-8adda9d8503a" returned: 0 in 0.534s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-e4a89387-e990-4762-8289-8adda9d8503a" released by "_delete_snapshot" :: held 2.399s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" released by "delete_snapshot" :: held 2.416s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:46 devstack cinder-volume[83114]: WARNING cinder.quota [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-856640388 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-856640388, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:46 devstack cinder-volume[83114]: WARNING cinder.quota [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-856640388 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-856640388, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Created reservations ['5a1ba7ce-93b0-4213-82d6-64a4c7c756a7', '87a5e0fe-e212-4058-a8bf-3111b5eee377', 'b9db350a-5694-41cc-9177-0db53be01b0f', 'c2cd664d-ae44-42f2-8f4b-bfcd53a43bd9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] Created reservations ['d9901049-c704-4b57-8d78-707cd901d68a', '6d39313b-d676-4ebc-9ffe-763a19017c6b', '688efa81-fffb-400a-88e6-b34625a7d313', 'daa50234-0349-407f-af85-ead30d05376f'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:46 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c6afaf7d-107f-4e12-bbdc-00ebf6b889cf tempest-GroupSnapshotsTest-976833075 None] group_snapshot ff7a419a-9341-4653-ab66-582ff531e26a: deleted successfully Feb 27 12:30:46 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.info" returned: 0 in 0.501s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:46 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-72f2e259-4c95-484e-b7e0-9c152eff155b tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Create snapshot completed successfully Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3090aa3-2c74-4597-8c5c-415d65ac2a59]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:47 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae Feb 27 12:30:47 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "cinder-518d2040-d3a7-4c8f-8f3c-0e0e23395d98-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-518d2040-d3a7-4c8f-8f3c-0e0e23395d98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "cinder-quobyte-72b10021-755a-4a11-b285-da928f4dea16" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-quobyte-72b10021-755a-4a11-b285-da928f4dea16" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "cinder-quobyte-518d2040-d3a7-4c8f-8f3c-0e0e23395d98" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-quobyte-518d2040-d3a7-4c8f-8f3c-0e0e23395d98" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Deleting offline snapshot 518d2040-d3a7-4c8f-8f3c-0e0e23395d98 of volume 72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] snapshot_file for this snap is: volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[48661a9e-577a-4cad-b99b-0b14a5e4bcb4]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:47 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 Feb 27 12:30:47 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:47 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" returned: 0 in 0.632s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:47 devstack sudo[84718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae Feb 27 12:30:47 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:48 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" returned: 0 in 0.523s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8b23805f-ee94-45b8-b1b7-d53849b3a2ae" released by "delete_volume" :: held 1.196s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:48 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98" returned: 0 in 0.646s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72b10021-755a-4a11-b285-da928f4dea16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd27ac82-6710-4c79-b13e-56ef90c3ccd0]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" acquired by "delete_volume" :: waited 0.030s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[89293033-60f3-4f95-a720-ea3685a04d16]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:48 devstack sudo[84727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 Feb 27 12:30:48 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:48 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 Feb 27 12:30:48 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:49 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16" returned: 0 in 0.607s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:49 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" returned: 0 in 0.574s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:49 devstack sudo[84737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 Feb 27 12:30:49 devstack sudo[84737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:49 devstack sudo[84738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560 Feb 27 12:30:49 devstack sudo[84738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:49 devstack sudo[84737]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98" returned: 0 in 0.497s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:49 devstack sudo[84738]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:49 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98 Feb 27 12:30:49 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-8dbfbf23-e029-4ff8-aab3-79bbbb1b5560" released by "delete_volume" :: held 1.124s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=129,cinder:INSERT=31,cinder:UPDATE=114,cinder:DELETE=8 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:UPDATE=132,cinder:SELECT=116,cinder:DELETE=7,cinder:INSERT=24 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Created reservations ['c161abfe-caa2-4532-850c-5ed79af52256'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:49 devstack cinder-volume[83114]: WARNING cinder.quota [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-856640388 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-856640388, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Created reservations ['3aee2665-c12d-4a28-8e4d-b31c4ea68c83', '9344d722-dfc4-4ef7-a55e-789c9ae85ca8', 'b035c05f-fce9-4819-92b9-74d6e909c423', '9dc051f4-a90d-47b6-a6a3-70d130430854'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:49 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Created reservations ['daefbdd3-0066-4550-ba87-5635807aacae', '801c9795-d918-4b00-9753-6e361829619a', '339ecefb-b295-4f5b-8cae-a46dd04839c2', 'c1577b09-58cc-4b24-a4f6-50dc9ad09b56'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:50 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:50 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:50 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16.518d2040-d3a7-4c8f-8f3c-0e0e23395d98" returned: 0 in 0.692s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-quobyte-518d2040-d3a7-4c8f-8f3c-0e0e23395d98" released by "_delete_snapshot" :: held 2.535s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-quobyte-72b10021-755a-4a11-b285-da928f4dea16" released by "delete_snapshot" :: held 2.556s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:50 devstack cinder-volume[83114]: WARNING cinder.quota [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Created reservations ['fe80ff52-26c0-4d64-8ba5-1534f1795ac6', '4b921fb8-ae2a-4a40-90c2-06a799ecf734', '3af27b02-3df7-4c30-81e9-a8c3c9734822', '9fde351e-baf2-4557-b8cb-2ec46b8bd5cc'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:50 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Delete snapshot completed successfully. Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-885f18c8-5ba9-45e6-a0d7-8ac1920db48c tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-518d2040-d3a7-4c8f-8f3c-0e0e23395d98-delete_snapshot" released by "delete_snapshot" :: held 2.790s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:50 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.701s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:50 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:50 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-79f8bbc3-c0b4-4b15-8d9a-4c439b5dd41e tempest-GroupSnapshotsTest-976833075 None] Delete group completed successfully. Feb 27 12:30:51 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d5933b5c-81af-4008-8c93-78ffbf13dab8 tempest-GroupSnapshotsTest-976833075 None] Group tempest-GroupSnapshotsTest-Group-1937331664: creating Feb 27 12:30:51 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d5933b5c-81af-4008-8c93-78ffbf13dab8 tempest-GroupSnapshotsTest-976833075 None] Group tempest-GroupSnapshotsTest-Group-1937331664: created successfully Feb 27 12:30:51 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d5933b5c-81af-4008-8c93-78ffbf13dab8 tempest-GroupSnapshotsTest-976833075 None] Create group completed successfully. Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "cinder-72b10021-755a-4a11-b285-da928f4dea16-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-72b10021-755a-4a11-b285-da928f4dea16-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "cinder-quobyte-72b10021-755a-4a11-b285-da928f4dea16" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-quobyte-72b10021-755a-4a11-b285-da928f4dea16" acquired by "delete_volume" :: waited 0.020s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ae2d9-f652-4e8c-971f-05b9a0635ffa]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:51 devstack sudo[84779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 Feb 27 12:30:51 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:51 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16" returned: 0 in 0.545s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:51 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16 Feb 27 12:30:51 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:52 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72b10021-755a-4a11-b285-da928f4dea16" returned: 0 in 0.565s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-quobyte-72b10021-755a-4a11-b285-da928f4dea16" released by "delete_volume" :: held 1.161s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Created reservations ['f8a4f241-104a-44c0-9191-135d0875cc5d', '02790c8d-cf92-4fbe-b54e-0ec1be5a0fe3', '6f4688ce-9c43-48c2-9e85-582d3591e09e', '6f374ffc-e16e-4902-ac4f-ea4a59d73b66'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:52 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:30:52 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (339fdf81-7ec2-4459-9115-0c1e6c108097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0446832-d395-4302-b0ee-1b7c2fa977c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0446832-d395-4302-b0ee-1b7c2fa977c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860584537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea5c8213-4db4-4485-bf81-eded3f06c49e,host='devstack@QuobyteHD#QuobyteHD',id=d839ece7-3875-4eaf-a8b0-e39f92394f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:53Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a2970a0-8863-448a-913d-fe1298104183),volume_type_id=4a2970a0-8863-448a-913d-fe1298104183)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e94a3e-1929-4460-9ec1-f8d4495d4e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e94a3e-1929-4460-9ec1-f8d4495d4e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9f8f0a-5c5c-46f3-8759-0a9e860633aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9f8f0a-5c5c-46f3-8759-0a9e860633aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd839ece7-3875-4eaf-a8b0-e39f92394f02', 'volume_name': 'volume-d839ece7-3875-4eaf-a8b0-e39f92394f02', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f591ce-37d5-489b-96c8-e52e689fcc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f591ce-37d5-489b-96c8-e52e689fcc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dad8b54-0fc1-46f4-852f-27616c66a02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:52 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Volume d839ece7-3875-4eaf-a8b0-e39f92394f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d839ece7-3875-4eaf-a8b0-e39f92394f02', 'volume_size': 1} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea5c8213-4db4-4485-bf81-eded3f06c49e,created_at=2026-02-27T11:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-860584537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea5c8213-4db4-4485-bf81-eded3f06c49e,host='devstack@QuobyteHD#QuobyteHD',id=d839ece7-3875-4eaf-a8b0-e39f92394f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fba5f64482f4a95bddccf7191570d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:30:53Z,use_quota=True,user_id='32ae9d703eaa46138975a903ab1e0280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a2970a0-8863-448a-913d-fe1298104183),volume_type_id=4a2970a0-8863-448a-913d-fe1298104183)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Creating volume d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:30:52 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:30:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:52 devstack sudo[84789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 1073741824 Feb 27 12:30:52 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:53 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.589s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:53 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:30:53 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Deleted volume successfully. Feb 27 12:30:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-52d0906b-a961-4b34-8d8d-3a4fec4000c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1074063885 None] Lock "cinder-72b10021-755a-4a11-b285-da928f4dea16-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:30:53 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 1073741824" returned: 0 in 0.963s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:53 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 Feb 27 12:30:53 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:55 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02" returned: 0 in 1.202s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:30:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:30:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dad8b54-0fc1-46f4-852f-27616c66a02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d839ece7-3875-4eaf-a8b0-e39f92394f02', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaba86a-fcff-4876-a85a-d0a17d78fa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:30:55 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Volume volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 (d839ece7-3875-4eaf-a8b0-e39f92394f02): created successfully Feb 27 12:30:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaba86a-fcff-4876-a85a-d0a17d78fa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:30:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Flow 'volume_create_manager' (339fdf81-7ec2-4459-9115-0c1e6c108097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:30:55 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-438733a7-5fb5-4e97-a2e6-3a7acfb349c5 tempest-GroupSnapshotsTest-976833075 None] Created volume successfully. Feb 27 12:30:56 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] GroupSnapshot 5a1f672c-3550-4583-a375-8506d649d992: creating. Feb 27 12:30:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Group snapshot 5a1f672c-3550-4583-a375-8506d649d992: creating. {{(pid=83114) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:30:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:30:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:30:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Creating offline snapshot 575b33a5-6e3a-41d6-b0ab-e52a5f06621b of volume d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:30:56 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0448bd6c-0a3c-4a24-9255-5a340fc152be]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:30:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:56 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 Feb 27 12:30:56 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:57 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02" returned: 0 in 0.842s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:57 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b 1G Feb 27 12:30:57 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:58 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b 1G" returned: 0 in 0.836s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:58 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b Feb 27 12:30:58 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:30:58 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Feb 27 12:30:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b" returned: 0 in 0.833s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:30:58 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:30:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:30:59 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b Feb 27 12:30:59 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:00 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b" returned: 0 in 1.147s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:00 devstack sudo[84830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.info Feb 27 12:31:00 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:00 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.info" returned: 0 in 0.591s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:00 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:31:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:00 devstack sudo[84837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.info Feb 27 12:31:00 devstack sudo[84837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:01 devstack sudo[84837]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.info" returned: 0 in 0.902s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.239s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:01 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-91c0ebaa-775f-4e93-be1d-808ca735091f tempest-GroupSnapshotsTest-976833075 None] group_snapshot 5a1f672c-3550-4583-a375-8506d649d992: created successfully Feb 27 12:31:03 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] group_snapshot 5a1f672c-3550-4583-a375-8506d649d992: deleting Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] group_snapshot 5a1f672c-3550-4583-a375-8506d649d992: deleting {{(pid=83114) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-d839ece7-3875-4eaf-a8b0-e39f92394f02" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-d839ece7-3875-4eaf-a8b0-e39f92394f02" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-575b33a5-6e3a-41d6-b0ab-e52a5f06621b" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-575b33a5-6e3a-41d6-b0ab-e52a5f06621b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Deleting offline snapshot 575b33a5-6e3a-41d6-b0ab-e52a5f06621b of volume d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] snapshot_file for this snap is: volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a4b751-65c1-4ed9-ae7a-a47df17cb699]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:03 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b Feb 27 12:31:03 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:03 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b" returned: 0 in 0.733s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d839ece7-3875-4eaf-a8b0-e39f92394f02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:04 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52bc99b-b6df-4d18-8377-1b323c4fcefd]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:04 devstack sudo[84897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 Feb 27 12:31:04 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:04 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02" returned: 0 in 0.678s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:04 devstack sudo[84905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b Feb 27 12:31:04 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:05 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b" returned: 0 in 0.610s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:05 devstack sudo[84910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b Feb 27 12:31:05 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:05 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02.575b33a5-6e3a-41d6-b0ab-e52a5f06621b" returned: 0 in 0.519s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-575b33a5-6e3a-41d6-b0ab-e52a5f06621b" released by "_delete_snapshot" :: held 2.651s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-d839ece7-3875-4eaf-a8b0-e39f92394f02" released by "delete_snapshot" :: held 2.681s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:05 devstack cinder-volume[83114]: WARNING cinder.quota [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1929398672 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1929398672, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:31:05 devstack cinder-volume[83114]: WARNING cinder.quota [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1929398672 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1929398672, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:31:05 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] Created reservations ['e77f5a47-b401-4bb3-87ff-ae0d289fa201', 'f40ec5ec-779d-4515-9627-e9c07fc88d3c', '38ad8c06-3eb2-40f8-a6f5-8900acf0ebec', '8753f3fd-2ca5-4ecf-823f-cb4b386011c9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:06 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-fb23e358-616f-4206-ae66-d12b64b0c51b tempest-GroupSnapshotsTest-976833075 None] group_snapshot 5a1f672c-3550-4583-a375-8506d649d992: deleted successfully Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "cinder-quobyte-d839ece7-3875-4eaf-a8b0-e39f92394f02" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-d839ece7-3875-4eaf-a8b0-e39f92394f02" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8eb023-aa9a-4e44-a2c4-3cbf071bf238]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:07 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 Feb 27 12:31:07 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:07 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:07 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:08 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02" returned: 0 in 1.595s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:08 devstack sudo[84966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02 Feb 27 12:31:08 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:09 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 1.732s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:09 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d839ece7-3875-4eaf-a8b0-e39f92394f02" returned: 0 in 0.784s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Lock "cinder-quobyte-d839ece7-3875-4eaf-a8b0-e39f92394f02" released by "delete_volume" :: held 2.451s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Created reservations ['9a977246-ec47-409c-966f-78f32e4a7311'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:09 devstack cinder-volume[83114]: WARNING cinder.quota [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1929398672 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1929398672, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Created reservations ['c3f81331-2bca-4c3e-97d7-c87d694449e0', '9fd7cbe3-ee53-4d8c-9267-03656462f838', '69d5ec49-6744-454f-8788-2a1d7a13adf9', '288d49b8-fddc-4782-9a1d-5d16feb45ad3'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:09 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:09 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:10 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.953s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:10 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-75f87603-da58-4dd7-92af-e590b3ffbd79 tempest-GroupSnapshotsTest-976833075 None] Delete group completed successfully. Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Flow 'volume_create_manager' (5b5c9cbd-651c-467d-b698-e295f4f5a544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1babf3c-0a58-4ce5-99a0-fd5fd59a7393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1babf3c-0a58-4ce5-99a0-fd5fd59a7393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-533217726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c383739-c486-4ccd-ab94-3d219cde6685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b60e7ecd8348c594b34306cfa926a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:13Z,use_quota=True,user_id='8fd294a3ecb24c52825bdbf10c78cb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6989a3a8-8b1a-4e21-a5aa-b0fc5a77fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6989a3a8-8b1a-4e21-a5aa-b0fc5a77fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20899cbf-d1df-4e7b-b918-a3125f5b0ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20899cbf-d1df-4e7b-b918-a3125f5b0ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c383739-c486-4ccd-ab94-3d219cde6685', 'volume_name': 'volume-1c383739-c486-4ccd-ab94-3d219cde6685', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a674bd-9c80-4d19-ac47-1f7c0972e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a674bd-9c80-4d19-ac47-1f7c0972e390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a08ba36-98f2-4028-a319-5c4651f507cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:12 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Volume 1c383739-c486-4ccd-ab94-3d219cde6685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c383739-c486-4ccd-ab94-3d219cde6685', 'volume_size': 1} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-533217726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c383739-c486-4ccd-ab94-3d219cde6685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b60e7ecd8348c594b34306cfa926a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:13Z,use_quota=True,user_id='8fd294a3ecb24c52825bdbf10c78cb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Creating volume 1c383739-c486-4ccd-ab94-3d219cde6685 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:12 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:12 devstack sudo[85017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 1073741824 Feb 27 12:31:12 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:13 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 1073741824" returned: 0 in 0.821s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:13 devstack sudo[85040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 Feb 27 12:31:13 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:14 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685" returned: 0 in 0.561s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a08ba36-98f2-4028-a319-5c4651f507cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c383739-c486-4ccd-ab94-3d219cde6685', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b3ea5c-5463-4768-a585-e9c260017c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:14 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Volume volume-1c383739-c486-4ccd-ab94-3d219cde6685 (1c383739-c486-4ccd-ab94-3d219cde6685): created successfully Feb 27 12:31:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b3ea5c-5463-4768-a585-e9c260017c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Flow 'volume_create_manager' (5b5c9cbd-651c-467d-b698-e295f4f5a544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-79b09770-50f6-46e4-ad9d-f7b32d9aff9e tempest-VolumesListAdminTestJSON-850894385 None] Created volume successfully. Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Flow 'volume_create_manager' (3db1ec74-ce7b-4991-8102-2b8a993d897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13de6008-af4f-4a1a-a204-ad7f78fa262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13de6008-af4f-4a1a-a204-ad7f78fa262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-76844969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09556d96-f874-4029-80e3-3b7c0cc8e977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b60e7ecd8348c594b34306cfa926a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:15Z,use_quota=True,user_id='8fd294a3ecb24c52825bdbf10c78cb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3f70e2-8732-4ef0-ab3c-89a21479b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3f70e2-8732-4ef0-ab3c-89a21479b181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05be9334-45eb-41d5-847a-616abd804a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05be9334-45eb-41d5-847a-616abd804a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09556d96-f874-4029-80e3-3b7c0cc8e977', 'volume_name': 'volume-09556d96-f874-4029-80e3-3b7c0cc8e977', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019bd67b-3d50-40bc-8cbb-4bdf8c2f27ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019bd67b-3d50-40bc-8cbb-4bdf8c2f27ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7be679-074e-4eb0-9cda-b25ab2f80127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:15 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Volume 09556d96-f874-4029-80e3-3b7c0cc8e977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09556d96-f874-4029-80e3-3b7c0cc8e977', 'volume_size': 1} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-76844969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09556d96-f874-4029-80e3-3b7c0cc8e977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b60e7ecd8348c594b34306cfa926a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:15Z,use_quota=True,user_id='8fd294a3ecb24c52825bdbf10c78cb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Creating volume 09556d96-f874-4029-80e3-3b7c0cc8e977 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:15 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:15 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 1073741824 Feb 27 12:31:15 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:15 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 1073741824" returned: 0 in 0.567s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:15 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 Feb 27 12:31:15 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:16 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977" returned: 0 in 0.601s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7be679-074e-4eb0-9cda-b25ab2f80127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09556d96-f874-4029-80e3-3b7c0cc8e977', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2e9d0f-3f8f-42a2-8698-9d472293121d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:16 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Volume volume-09556d96-f874-4029-80e3-3b7c0cc8e977 (09556d96-f874-4029-80e3-3b7c0cc8e977): created successfully Feb 27 12:31:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2e9d0f-3f8f-42a2-8698-9d472293121d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Flow 'volume_create_manager' (3db1ec74-ce7b-4991-8102-2b8a993d897a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:16 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-90216c9c-44c6-4e6d-964c-57f7f249ca38 tempest-VolumesListAdminTestJSON-850894385 None] Created volume successfully. Feb 27 12:31:17 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Flow 'volume_create_manager' (8e741457-b5f5-4103-a8d2-9672ffcd4bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48761914-796f-4282-b690-71fa6e93d8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48761914-796f-4282-b690-71fa6e93d8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061307013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95577981-8d7c-410b-8d86-aebe7a7ad971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b60e7ecd8348c594b34306cfa926a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:18Z,use_quota=True,user_id='8fd294a3ecb24c52825bdbf10c78cb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866e2008-5b1f-4224-bcdd-c530d62001fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866e2008-5b1f-4224-bcdd-c530d62001fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801936db-209a-4167-9933-c718cae703b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801936db-209a-4167-9933-c718cae703b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95577981-8d7c-410b-8d86-aebe7a7ad971', 'volume_name': 'volume-95577981-8d7c-410b-8d86-aebe7a7ad971', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d50ead-4629-4e1a-87e6-f8d3d0dd92cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d50ead-4629-4e1a-87e6-f8d3d0dd92cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e74340-b773-4f4d-9496-033a8fb65f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Volume 95577981-8d7c-410b-8d86-aebe7a7ad971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95577981-8d7c-410b-8d86-aebe7a7ad971', 'volume_size': 1} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061307013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95577981-8d7c-410b-8d86-aebe7a7ad971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b60e7ecd8348c594b34306cfa926a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:18Z,use_quota=True,user_id='8fd294a3ecb24c52825bdbf10c78cb7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Creating volume 95577981-8d7c-410b-8d86-aebe7a7ad971 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:18 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:18 devstack sudo[85078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 1073741824 Feb 27 12:31:18 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Flow 'volume_create_manager' (b3d1988e-1202-4406-a38f-92fede90d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0943fbc-3114-4ca7-996b-2ab7d9cb5ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0943fbc-3114-4ca7-996b-2ab7d9cb5ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-121869237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d203ec-95ef-4523-918f-1465fba13007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38cd8807f084a85b016bee5873486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:18Z,use_quota=True,user_id='dac4b7cac6794b00b66ecbb4c1fc9868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809953c9-f366-4607-ae27-c322780891d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809953c9-f366-4607-ae27-c322780891d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26837a8e-ed94-4fae-a8af-9a4d868678e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26837a8e-ed94-4fae-a8af-9a4d868678e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d203ec-95ef-4523-918f-1465fba13007', 'volume_name': 'volume-77d203ec-95ef-4523-918f-1465fba13007', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f8d8e8-acf9-45fe-88f4-413652270a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f8d8e8-acf9-45fe-88f4-413652270a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110ae8b6-0ed9-4560-9069-2fbae7cad8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Volume 77d203ec-95ef-4523-918f-1465fba13007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d203ec-95ef-4523-918f-1465fba13007', 'volume_size': 1} Feb 27 12:31:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:18 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 1073741824" returned: 0 in 0.912s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:19 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 Feb 27 12:31:19 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6e8ab92f-21da-4330-8247-765e2c356f1d tempest-GroupsV320Test-956893583 None] Group tempest-GroupsV320Test-Group-211724331: creating Feb 27 12:31:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6e8ab92f-21da-4330-8247-765e2c356f1d tempest-GroupsV320Test-956893583 None] Group tempest-GroupsV320Test-Group-211724331: created successfully Feb 27 12:31:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6e8ab92f-21da-4330-8247-765e2c356f1d tempest-GroupsV320Test-956893583 None] Create group completed successfully. Feb 27 12:31:19 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971" returned: 0 in 0.812s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-121869237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d203ec-95ef-4523-918f-1465fba13007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38cd8807f084a85b016bee5873486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:18Z,use_quota=True,user_id='dac4b7cac6794b00b66ecbb4c1fc9868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Creating volume 77d203ec-95ef-4523-918f-1465fba13007 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:19 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e74340-b773-4f4d-9496-033a8fb65f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95577981-8d7c-410b-8d86-aebe7a7ad971', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a526e6-44fb-48bc-a09d-ad953bc57383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:19 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 1073741824 Feb 27 12:31:19 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Volume volume-95577981-8d7c-410b-8d86-aebe7a7ad971 (95577981-8d7c-410b-8d86-aebe7a7ad971): created successfully Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a526e6-44fb-48bc-a09d-ad953bc57383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Flow 'volume_create_manager' (8e741457-b5f5-4103-a8d2-9672ffcd4bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ce5a53c1-05ed-4f2a-89aa-bae88f28ac4c tempest-VolumesListAdminTestJSON-850894385 None] Created volume successfully. Feb 27 12:31:20 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 1073741824" returned: 0 in 0.942s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:20 devstack sudo[85092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 Feb 27 12:31:20 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Flow 'volume_create_manager' (b2bd48c1-3134-41e6-b834-2801ea40a555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f716f3c2-2e1b-4b96-a815-3ffbbde89ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f716f3c2-2e1b-4b96-a815-3ffbbde89ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f906dc72-c4be-4352-805f-c0daaff544b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b61f63b17c241388859c5f062c5681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:21Z,use_quota=True,user_id='8ca38838c92b4d419e2d1ce0f49f36b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b4a872-5b44-4200-b849-ac9b3b7a71a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b4a872-5b44-4200-b849-ac9b3b7a71a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea52f4e-ce54-433c-8aa9-ab8ba26aa720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea52f4e-ce54-433c-8aa9-ab8ba26aa720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f906dc72-c4be-4352-805f-c0daaff544b8', 'volume_name': 'volume-f906dc72-c4be-4352-805f-c0daaff544b8', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b818d9b-f597-4974-a73c-88f98ab24e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b818d9b-f597-4974-a73c-88f98ab24e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3004c6d6-0f95-4d11-b1c4-55df9dc9b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Volume f906dc72-c4be-4352-805f-c0daaff544b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f906dc72-c4be-4352-805f-c0daaff544b8', 'volume_size': 1} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Created reservations ['533d18d5-ba8e-4a3b-8d9e-6bd65cfb425d'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:21 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:21 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007" returned: 0 in 0.672s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:21 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f906dc72-c4be-4352-805f-c0daaff544b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b61f63b17c241388859c5f062c5681c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:21Z,use_quota=True,user_id='8ca38838c92b4d419e2d1ce0f49f36b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Creating volume f906dc72-c4be-4352-805f-c0daaff544b8 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:21 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110ae8b6-0ed9-4560-9069-2fbae7cad8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d203ec-95ef-4523-918f-1465fba13007', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0ec115-4100-4e2f-ac7e-ff3fbd4121b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Volume volume-77d203ec-95ef-4523-918f-1465fba13007 (77d203ec-95ef-4523-918f-1465fba13007): created successfully Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0ec115-4100-4e2f-ac7e-ff3fbd4121b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Flow 'volume_create_manager' (b3d1988e-1202-4406-a38f-92fede90d132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:21 devstack sudo[85097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 1073741824 Feb 27 12:31:21 devstack sudo[85097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-77cdc385-fcae-4c25-ba2d-86cf7ef35774 tempest-ServersNegativeTestJSON-1177895406 None] Created volume successfully. Feb 27 12:31:21 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.547s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:21 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-addada58-b07a-4992-b8b5-78cf19794756 tempest-GroupsV320Test-956893583 None] Delete group completed successfully. Feb 27 12:31:22 devstack sudo[85097]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 1073741824" returned: 0 in 0.683s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:22 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 Feb 27 12:31:22 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:22 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8" returned: 0 in 0.737s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3004c6d6-0f95-4d11-b1c4-55df9dc9b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f906dc72-c4be-4352-805f-c0daaff544b8', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de12f0e-5c27-4c31-b328-cd68247af4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:23 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Volume volume-f906dc72-c4be-4352-805f-c0daaff544b8 (f906dc72-c4be-4352-805f-c0daaff544b8): created successfully Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de12f0e-5c27-4c31-b328-cd68247af4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Flow 'volume_create_manager' (b2bd48c1-3134-41e6-b834-2801ea40a555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:23 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-eebf7216-6818-4048-8de1-61be74edfee4 tempest-VolumesListAdminTestJSON-72252412 None] Created volume successfully. Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Acquiring lock "cinder-f906dc72-c4be-4352-805f-c0daaff544b8-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Lock "cinder-f906dc72-c4be-4352-805f-c0daaff544b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Acquiring lock "cinder-quobyte-f906dc72-c4be-4352-805f-c0daaff544b8" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Lock "cinder-quobyte-f906dc72-c4be-4352-805f-c0daaff544b8" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f05899-54d5-4564-b144-74cf8ff9cbfc]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "cinder-95577981-8d7c-410b-8d86-aebe7a7ad971-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-95577981-8d7c-410b-8d86-aebe7a7ad971-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "cinder-quobyte-95577981-8d7c-410b-8d86-aebe7a7ad971" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-quobyte-95577981-8d7c-410b-8d86-aebe7a7ad971" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cd3019-9f14-4b81-868b-83dbbc69be40]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:23 devstack sudo[85107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 Feb 27 12:31:23 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:24 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 Feb 27 12:31:24 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:24 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8" returned: 0 in 1.036s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:24 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8 Feb 27 12:31:24 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Flow 'volume_create_manager' (463f6702-47ca-4a69-8279-ef1f3fd0ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522c73d9-ebad-4e30-8c96-4be7182b36d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (522c73d9-ebad-4e30-8c96-4be7182b36d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1009205423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44dde56f-6bf6-4296-a221-dac09e4a3b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38cd8807f084a85b016bee5873486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:25Z,use_quota=True,user_id='dac4b7cac6794b00b66ecbb4c1fc9868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d6f1ed-3069-44f3-b32b-c1018265c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d6f1ed-3069-44f3-b32b-c1018265c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad12d363-670e-4145-9c15-f817189a7610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad12d363-670e-4145-9c15-f817189a7610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44dde56f-6bf6-4296-a221-dac09e4a3b53', 'volume_name': 'volume-44dde56f-6bf6-4296-a221-dac09e4a3b53', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27a659e-9df2-473d-a487-ffa10145bdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27a659e-9df2-473d-a487-ffa10145bdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e990192-30f1-4d02-8fd4-4a544da67844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:24 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Volume 44dde56f-6bf6-4296-a221-dac09e4a3b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44dde56f-6bf6-4296-a221-dac09e4a3b53', 'volume_size': 1} Feb 27 12:31:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1009205423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44dde56f-6bf6-4296-a221-dac09e4a3b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38cd8807f084a85b016bee5873486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:25Z,use_quota=True,user_id='dac4b7cac6794b00b66ecbb4c1fc9868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Creating volume 44dde56f-6bf6-4296-a221-dac09e4a3b53 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:25 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:25 devstack sudo[85148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 1073741824 Feb 27 12:31:25 devstack sudo[85148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:25 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971" returned: 0 in 1.418s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:25 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971 Feb 27 12:31:25 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:25 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f906dc72-c4be-4352-805f-c0daaff544b8" returned: 0 in 0.840s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Lock "cinder-quobyte-f906dc72-c4be-4352-805f-c0daaff544b8" released by "delete_volume" :: held 1.927s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Created reservations ['01729057-f8f5-400e-afce-378cbcc8fdef', '8dd9c09a-6a3b-4814-8ffb-f34754612416', '3db3ead1-a4b1-4187-ae42-74829dfde697', '6c11fc9f-eb15-4ec3-9d96-11ce4877b610'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:25 devstack sudo[85155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:25 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:26 devstack sudo[85148]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 1073741824" returned: 0 in 1.292s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:26 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 Feb 27 12:31:26 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:26 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-95577981-8d7c-410b-8d86-aebe7a7ad971" returned: 0 in 1.154s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-quobyte-95577981-8d7c-410b-8d86-aebe7a7ad971" released by "delete_volume" :: held 2.636s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:26 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.774s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:26 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Deleted volume successfully. Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ecc37ce-20a2-4d12-b06d-7c23e80510c7 tempest-VolumesListAdminTestJSON-72252412 None] Lock "cinder-f906dc72-c4be-4352-805f-c0daaff544b8-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Created reservations ['673ecc81-dbe7-4f40-a861-3c266e37ce06', '41e135c9-c0ef-46dc-ba2d-2b4b2dcaff6b', '9a58aec2-2f77-491b-bc4d-f366406950e3', '7d42744e-880d-4708-a83f-678ff47a2765'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:26 devstack sudo[85164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:26 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:27 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53" returned: 0 in 0.701s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e990192-30f1-4d02-8fd4-4a544da67844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44dde56f-6bf6-4296-a221-dac09e4a3b53', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b7876d-3062-4eda-b623-f22c4cd5da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:27 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Volume volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 (44dde56f-6bf6-4296-a221-dac09e4a3b53): created successfully Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b7876d-3062-4eda-b623-f22c4cd5da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Flow 'volume_create_manager' (463f6702-47ca-4a69-8279-ef1f3fd0ee90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "cinder-09556d96-f874-4029-80e3-3b7c0cc8e977-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:27 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-133a98b2-c570-42b6-b095-1025c9d385bd tempest-ServersNegativeTestJSON-1177895406 None] Created volume successfully. Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-09556d96-f874-4029-80e3-3b7c0cc8e977-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "cinder-quobyte-09556d96-f874-4029-80e3-3b7c0cc8e977" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-quobyte-09556d96-f874-4029-80e3-3b7c0cc8e977" acquired by "delete_volume" :: waited 0.024s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[480c32d0-8a3a-4f53-a314-98df54042997]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:27 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.714s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:27 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Deleted volume successfully. Feb 27 12:31:27 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 Feb 27 12:31:27 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-22470900-09c2-431b-be4c-811ad5974303 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-95577981-8d7c-410b-8d86-aebe7a7ad971-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:27 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977" returned: 0 in 0.574s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:27 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977 Feb 27 12:31:27 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:28 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-09556d96-f874-4029-80e3-3b7c0cc8e977" returned: 0 in 0.791s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-quobyte-09556d96-f874-4029-80e3-3b7c0cc8e977" released by "delete_volume" :: held 1.411s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "cinder-44dde56f-6bf6-4296-a221-dac09e4a3b53-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-44dde56f-6bf6-4296-a221-dac09e4a3b53-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Created reservations ['0a8fe5f1-2909-4cc2-b16e-ca04a53260ea', '90b83329-6a8b-4049-ac42-92a5aa9e6c9f', '8bedd3e2-0c52-48e4-9539-00c961d06e3a', 'cb2705cd-deb6-4d19-b70d-ab3ca5cdaff0'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "cinder-quobyte-44dde56f-6bf6-4296-a221-dac09e4a3b53" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-quobyte-44dde56f-6bf6-4296-a221-dac09e4a3b53" acquired by "delete_volume" :: waited 0.034s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[8417f3aa-ab4b-4d0f-bb79-692e0d971f4f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:28 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:28 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:28 devstack sudo[85177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 Feb 27 12:31:28 devstack sudo[85177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Flow 'volume_create_manager' (36f6d946-1248-48b1-86a5-2cbbed62f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d2edc7-29a6-438c-bf56-0c86db34ca0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d2edc7-29a6-438c-bf56-0c86db34ca0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-30456782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9283dd39-f408-48c4-8c2f-a58f503c8b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8e87cfeb8347f5ba0fafb10980d281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:29Z,use_quota=True,user_id='bc4a8519cc1d451b9bec8413a43cbcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1710043a-ab20-44e9-b4d5-c77dc89b2eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1710043a-ab20-44e9-b4d5-c77dc89b2eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d78cfdb-bd8b-49cb-b1fd-93dcb88082cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d78cfdb-bd8b-49cb-b1fd-93dcb88082cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9283dd39-f408-48c4-8c2f-a58f503c8b9c', 'volume_name': 'volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b617de-0e4b-424e-b053-8e06e82058e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b617de-0e4b-424e-b053-8e06e82058e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467f6b7a-53b4-4c8f-86f4-bc130917b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:29 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c', 'volume_size': 1} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-30456782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9283dd39-f408-48c4-8c2f-a58f503c8b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8e87cfeb8347f5ba0fafb10980d281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:29Z,use_quota=True,user_id='bc4a8519cc1d451b9bec8413a43cbcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Creating volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:29 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:29 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c 1073741824 Feb 27 12:31:29 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "cinder-1c383739-c486-4ccd-ab94-3d219cde6685-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-1c383739-c486-4ccd-ab94-3d219cde6685-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "cinder-quobyte-1c383739-c486-4ccd-ab94-3d219cde6685" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-quobyte-1c383739-c486-4ccd-ab94-3d219cde6685" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa54ff2d-8d4d-4ef8-93e0-a244c3859cc5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:29 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.813s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Deleted volume successfully. Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3d5bd0cf-918c-4f08-9bb9-ccede422e94a tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-09556d96-f874-4029-80e3-3b7c0cc8e977-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:29 devstack sudo[85177]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53" returned: 0 in 0.908s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:29 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53 Feb 27 12:31:29 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:29 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 Feb 27 12:31:29 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:29 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c 1073741824" returned: 0 in 0.863s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:30 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c Feb 27 12:31:30 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:30 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-44dde56f-6bf6-4296-a221-dac09e4a3b53" returned: 0 in 0.618s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-quobyte-44dde56f-6bf6-4296-a221-dac09e4a3b53" released by "delete_volume" :: held 1.566s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Created reservations ['3d08583d-2d89-4531-9a1e-54f4f125b343', '8178f48d-1700-4075-8a5e-761a7347f79e', 'a6b3c2ae-fec6-46de-bd39-f3dac0f6fa47', '34b9d784-344e-4f5d-bb66-eb5e9f33b3b0'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:30 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:30 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:30 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c" returned: 0 in 0.633s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467f6b7a-53b4-4c8f-86f4-bc130917b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee037b-93e1-40fd-ac96-e394deb7536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:30 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Volume volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c (9283dd39-f408-48c4-8c2f-a58f503c8b9c): created successfully Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee037b-93e1-40fd-ac96-e394deb7536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Flow 'volume_create_manager' (36f6d946-1248-48b1-86a5-2cbbed62f9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f43a025d-36d4-4aae-99d8-5d8a630c8d52 tempest-SnapshotsActionsTest-1603213423 None] Created volume successfully. Feb 27 12:31:30 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685" returned: 0 in 1.025s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:30 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685 Feb 27 12:31:30 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "cinder-77d203ec-95ef-4523-918f-1465fba13007-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-77d203ec-95ef-4523-918f-1465fba13007-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "cinder-quobyte-77d203ec-95ef-4523-918f-1465fba13007" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:31 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.566s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-quobyte-77d203ec-95ef-4523-918f-1465fba13007" acquired by "delete_volume" :: waited 0.109s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:31 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Deleted volume successfully. Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2cc6c35-634c-452c-8a4f-222347fb5efe tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-44dde56f-6bf6-4296-a221-dac09e4a3b53-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[815ccba2-afb2-4758-adb8-086fbb460e75]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Creating offline snapshot e2a16831-32c9-4371-8c23-d45887e47d9d of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:31 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1c383739-c486-4ccd-ab94-3d219cde6685" returned: 0 in 0.632s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d13312-8aa3-4a1f-8661-1dbb4b7e0657]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-quobyte-1c383739-c486-4ccd-ab94-3d219cde6685" released by "delete_volume" :: held 1.705s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:31 devstack sudo[85210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 Feb 27 12:31:31 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Created reservations ['1fc3002c-def0-48a1-9a49-189b297c8445', 'b29f092f-ceec-41b3-a7ae-b78b494d997d', 'b941b80e-0c33-4d13-b6b4-1c2ef7dd09f4', 'a8a4925f-60b4-4050-aacf-f1ac146e19f7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:31 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c Feb 27 12:31:31 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:31 devstack sudo[85213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:31 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:32 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c" returned: 0 in 1.005s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:32 devstack sudo[85223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d 1G Feb 27 12:31:32 devstack sudo[85223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:32 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007" returned: 0 in 1.211s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:32 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007 Feb 27 12:31:32 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:32 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 1.199s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:32 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:32 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Deleted volume successfully. Feb 27 12:31:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ae90f3fd-ffc1-4238-aa8c-f6cec0646d30 tempest-VolumesListAdminTestJSON-850894385 None] Lock "cinder-1c383739-c486-4ccd-ab94-3d219cde6685-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:33 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77d203ec-95ef-4523-918f-1465fba13007" returned: 0 in 0.636s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-quobyte-77d203ec-95ef-4523-918f-1465fba13007" released by "delete_volume" :: held 1.932s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Created reservations ['b8547176-ff43-496f-b861-17bb50702177', '4f3abfd6-d13a-4836-8f95-96caa3f01a77', '1615d0f6-2778-4fc5-b185-a4539bb6c72b', '05969bbe-29ec-485b-9fbf-76b8cc659c2c'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:33 devstack sudo[85232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:33 devstack sudo[85232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:33 devstack sudo[85223]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d 1G" returned: 0 in 0.997s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:33 devstack sudo[85234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:33 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:33 devstack sudo[85232]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.585s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:33 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Deleted volume successfully. Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-97bf5f69-c57f-48c3-91fd-1708b25dc074 tempest-ServersNegativeTestJSON-1177895406 None] Lock "cinder-77d203ec-95ef-4523-918f-1465fba13007-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:33 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.540s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:33 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d is being set with open permissions: ugo+rw Feb 27 12:31:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:33 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:33 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:34 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.720s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:34 devstack sudo[85243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.info Feb 27 12:31:34 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:35 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.info" returned: 0 in 0.545s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:35 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.info is being set with open permissions: ugo+rw Feb 27 12:31:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:35 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.info Feb 27 12:31:35 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:35 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.info" returned: 0 in 0.830s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.761s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:36 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b7b57163-9b45-4196-8a19-2c3da82d9f31 tempest-SnapshotsActionsTest-1603213423 None] Create snapshot completed successfully Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Flow 'volume_create_manager' (41d61af8-19c7-42db-a2a6-e01c73f5db64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dfbff1-5008-4cfa-8fee-d5a51358488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dfbff1-5008-4cfa-8fee-d5a51358488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:36Z,deleted=False,deleted_at=None,display_description='',display_name='8e3b2313-b2e7-4ef8-93af-aa6bf080a5b6-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2316f2b6-efd4-42c8-95e3-53499fb383e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf06ef89d3304258b4e5c769a5bc2da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:37Z,use_quota=True,user_id='914119d6578e482db0eaa0e2a1ea0860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fa0c7a-debd-41f3-b17a-0846368a203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fa0c7a-debd-41f3-b17a-0846368a203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb32e8-241c-46ee-bb56-be6044edb825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb32e8-241c-46ee-bb56-be6044edb825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2316f2b6-efd4-42c8-95e3-53499fb383e6', 'volume_name': 'volume-2316f2b6-efd4-42c8-95e3-53499fb383e6', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce88ecce-1961-4776-b677-3256114caeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce88ecce-1961-4776-b677-3256114caeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a487526c-cd0d-4e3a-aeb2-279cf42227ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:36 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Volume 2316f2b6-efd4-42c8-95e3-53499fb383e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2316f2b6-efd4-42c8-95e3-53499fb383e6', 'volume_size': 1} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:36Z,deleted=False,deleted_at=None,display_description='',display_name='8e3b2313-b2e7-4ef8-93af-aa6bf080a5b6-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2316f2b6-efd4-42c8-95e3-53499fb383e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf06ef89d3304258b4e5c769a5bc2da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:37Z,use_quota=True,user_id='914119d6578e482db0eaa0e2a1ea0860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Creating volume 2316f2b6-efd4-42c8-95e3-53499fb383e6 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:36 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:36 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 1073741824 Feb 27 12:31:36 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Flow 'volume_create_manager' (055d8c02-7482-4ee5-a0dc-81d0b84c657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac64ff6-6a7b-435d-8760-08988d0f33eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac64ff6-6a7b-435d-8760-08988d0f33eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1646446398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb42b885-868d-4b7f-b86e-248bd176ffef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9301587dd3447828a110d564d160a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:38Z,use_quota=True,user_id='32c1c9efe17540ebb1472a70a5eecabd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dccc0ac-3b74-4615-9730-6c86c960f4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dccc0ac-3b74-4615-9730-6c86c960f4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0b6683-a3fa-46e0-b324-d7b3af876f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0b6683-a3fa-46e0-b324-d7b3af876f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb42b885-868d-4b7f-b86e-248bd176ffef', 'volume_name': 'volume-eb42b885-868d-4b7f-b86e-248bd176ffef', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72870189-2fc2-4d8c-87ce-5e706a325a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72870189-2fc2-4d8c-87ce-5e706a325a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0856d2cf-de7c-434c-a03b-295da67a0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:37 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Volume eb42b885-868d-4b7f-b86e-248bd176ffef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb42b885-868d-4b7f-b86e-248bd176ffef', 'volume_size': 1} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:37 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 1073741824" returned: 0 in 1.058s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:37 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 Feb 27 12:31:37 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:38 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6" returned: 0 in 0.472s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.611s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a487526c-cd0d-4e3a-aeb2-279cf42227ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2316f2b6-efd4-42c8-95e3-53499fb383e6', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43f8976-4e8f-4d93-934f-2385cdb6da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:38 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Volume volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 (2316f2b6-efd4-42c8-95e3-53499fb383e6): created successfully Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43f8976-4e8f-4d93-934f-2385cdb6da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Flow 'volume_create_manager' (41d61af8-19c7-42db-a2a6-e01c73f5db64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Creating offline snapshot af7c5784-154a-4660-b450-5a79e638708c of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:38 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-e0b50fa1-13d1-4483-864f-453900c8daa6 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Created volume successfully. Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bbc96e-76f1-48a5-9bc7-d909696e3be9]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:38 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:38 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:39 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.603s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:39 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c 1G Feb 27 12:31:39 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:39 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c 1G" returned: 0 in 0.540s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:39 devstack sudo[85302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c Feb 27 12:31:39 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:40 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c" returned: 0 in 0.414s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:40 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c is being set with open permissions: ugo+rw Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:40 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c Feb 27 12:31:40 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:40 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c" returned: 0 in 0.422s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.694s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1646446398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb42b885-868d-4b7f-b86e-248bd176ffef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9301587dd3447828a110d564d160a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:38Z,use_quota=True,user_id='32c1c9efe17540ebb1472a70a5eecabd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Creating volume eb42b885-868d-4b7f-b86e-248bd176ffef {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:40 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:40 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef 1073741824 Feb 27 12:31:40 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-06d89d27-b661-4732-b0e5-2e147f95a9d5 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:40 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0d6e2f2d-6474-44c5-9429-126320dde51a tempest-SnapshotsActionsTest-1603213423 None] Create snapshot completed successfully Feb 27 12:31:41 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-af7c5784-154a-4660-b450-5a79e638708c-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef 1073741824" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-af7c5784-154a-4660-b450-5a79e638708c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-af7c5784-154a-4660-b450-5a79e638708c" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-af7c5784-154a-4660-b450-5a79e638708c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Deleting offline snapshot af7c5784-154a-4660-b450-5a79e638708c of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] snapshot_file for this snap is: volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:41 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef Feb 27 12:31:41 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6373d8-f5f9-4d08-96b9-39715552b448]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:41 devstack sudo[85330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c Feb 27 12:31:41 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:41 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef" returned: 0 in 0.611s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-06d89d27-b661-4732-b0e5-2e147f95a9d5 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.172s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:41 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c" returned: 0 in 0.592s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ae6b1e-6b24-4974-b6cd-115eeab5a622]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-06d89d27-b661-4732-b0e5-2e147f95a9d5 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1685c3c-69d5-4821-8881-32bd4ffc2c86]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0856d2cf-de7c-434c-a03b-295da67a0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb42b885-868d-4b7f-b86e-248bd176ffef', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c39c8f9-362f-4e33-b5e7-036c031d7fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:41 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Volume volume-eb42b885-868d-4b7f-b86e-248bd176ffef (eb42b885-868d-4b7f-b86e-248bd176ffef): created successfully Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c39c8f9-362f-4e33-b5e7-036c031d7fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Flow 'volume_create_manager' (055d8c02-7482-4ee5-a0dc-81d0b84c657c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-39c29305-9fb6-464f-b6b2-54f54c4906ac tempest-VolumesTransfersTest-1742582625 None] Created volume successfully. Feb 27 12:31:41 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 Feb 27 12:31:41 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:41 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:41 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:42 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-06d89d27-b661-4732-b0e5-2e147f95a9d5 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6" returned: 0 in 0.577s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-06d89d27-b661-4732-b0e5-2e147f95a9d5 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.612s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-06d89d27-b661-4732-b0e5-2e147f95a9d5 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769', 'name': 'volume-2316f2b6-efd4-42c8-95e3-53499fb383e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38fb9413-c450-46c4-b25c-3abb19775729', 'enforce_multipath': True} {{(pid=83114) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 12:31:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-a54072c8-52f6-41d7-9d6a-b640ef7dd283 req-06d89d27-b661-4732-b0e5-2e147f95a9d5 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] attachment_update completed successfully. Feb 27 12:31:42 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.717s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:42 devstack sudo[85371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c Feb 27 12:31:42 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:43 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c" returned: 0 in 0.525s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:43 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c Feb 27 12:31:43 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-abc74938-58aa-45ba-bd3c-bb2b7275e633 tempest-VolumesTransfersTest-1952639903 None] Transfer volume completed successfully. Feb 27 12:31:43 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.af7c5784-154a-4660-b450-5a79e638708c" returned: 0 in 0.629s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-af7c5784-154a-4660-b450-5a79e638708c" released by "_delete_snapshot" :: held 2.599s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" released by "delete_snapshot" :: held 2.632s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:43 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Created reservations ['cdb0f5dc-a687-4f53-84b9-2535ce3d4e55', '62aeb432-82ec-49bc-857f-9c5b5e9381d8', 'f3b559e4-876e-4f01-8189-f0b165b4706a', 'fc3534fc-43ef-4e8f-8a18-a45f537cf5fb'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Delete snapshot completed successfully. Feb 27 12:31:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-302a7f3e-26f7-4bd1-aeb1-be4d87d54b88 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-af7c5784-154a-4660-b450-5a79e638708c-delete_snapshot" released by "delete_snapshot" :: held 2.736s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Acquiring lock "cinder-eb42b885-868d-4b7f-b86e-248bd176ffef-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-eb42b885-868d-4b7f-b86e-248bd176ffef-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Acquiring lock "cinder-quobyte-eb42b885-868d-4b7f-b86e-248bd176ffef" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-quobyte-eb42b885-868d-4b7f-b86e-248bd176ffef" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38d360-2dab-4b2f-92aa-670678989c55]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:44 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef Feb 27 12:31:44 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Creating offline snapshot a8ed76f4-70c2-4acb-b8bc-d01153e5655d of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad8a44c-cf38-43e7-9843-e8738c6fea6b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:44 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:44 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:45 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef" returned: 0 in 0.586s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:45 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef Feb 27 12:31:45 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:45 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.525s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:45 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d 1G Feb 27 12:31:45 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:45 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eb42b885-868d-4b7f-b86e-248bd176ffef" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-quobyte-eb42b885-868d-4b7f-b86e-248bd176ffef" released by "delete_volume" :: held 1.134s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Created reservations ['6e0f1a98-f024-4939-8e5c-436cc008b5c5', 'a4e94aad-e1cf-442e-8707-a6953a341f02', '80566175-df8b-41bd-ae8a-f1e87719e3e7', '4bf04ede-fb56-4a1b-b1a2-4b0c9d31fa10'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:45 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:45 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:46 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d 1G" returned: 0 in 0.731s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:46 devstack sudo[85470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d Feb 27 12:31:46 devstack sudo[85470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:46 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:46 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:46 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Deleted volume successfully. Feb 27 12:31:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-72326aac-6ecb-4276-8e1f-4a71ff0489e3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-eb42b885-868d-4b7f-b86e-248bd176ffef-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:46 devstack sudo[85470]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d" returned: 0 in 0.488s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:46 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d is being set with open permissions: ugo+rw Feb 27 12:31:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:46 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d Feb 27 12:31:46 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Flow 'volume_create_manager' (1047d598-65e8-466c-82d9-3041e3a70925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29f016b-81c9-4b4e-a4ec-6e812ffe3866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29f016b-81c9-4b4e-a4ec-6e812ffe3866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1536838504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6d6cd1-c114-45f1-86c3-93a4363fa424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9301587dd3447828a110d564d160a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:47Z,use_quota=True,user_id='32c1c9efe17540ebb1472a70a5eecabd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a0663a-3508-4fea-bc76-d5fdd1162bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a0663a-3508-4fea-bc76-d5fdd1162bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b7116d-6bec-43c8-a0d2-b18348188994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b7116d-6bec-43c8-a0d2-b18348188994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6d6cd1-c114-45f1-86c3-93a4363fa424', 'volume_name': 'volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6904033d-4aaf-49d3-abd5-23107137cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6904033d-4aaf-49d3-abd5-23107137cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d24bd-8f7a-4d2d-b3e9-6ece69248345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Volume dd6d6cd1-c114-45f1-86c3-93a4363fa424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424', 'volume_size': 1} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d" returned: 0 in 0.558s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1536838504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6d6cd1-c114-45f1-86c3-93a4363fa424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9301587dd3447828a110d564d160a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:47Z,use_quota=True,user_id='32c1c9efe17540ebb1472a70a5eecabd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Creating volume dd6d6cd1-c114-45f1-86c3-93a4363fa424 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:47 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:47 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 1073741824 Feb 27 12:31:47 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Flow 'volume_create_manager' (bcd621d0-1a09-4b3e-a8fc-e00dac9f387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820abe52-0a56-4b35-95a5-af89bc846f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820abe52-0a56-4b35-95a5-af89bc846f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-967527519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85198273-320a-44b6-9001-bd9a01f17eb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c769ca1151d4cb9ab3eb2fe6f1f88a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:47Z,use_quota=True,user_id='cf2d6420670a468ebf136ebe5c84fcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f7e0e-e80a-412e-9c4b-495efa4cc64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f7e0e-e80a-412e-9c4b-495efa4cc64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ab7d5a-62bb-464d-8dde-3d1c25843932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ab7d5a-62bb-464d-8dde-3d1c25843932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85198273-320a-44b6-9001-bd9a01f17eb5', 'volume_name': 'volume-85198273-320a-44b6-9001-bd9a01f17eb5', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effcfd84-2c2f-4e8f-8345-78f5ef971621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effcfd84-2c2f-4e8f-8345-78f5ef971621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f613eaf-347d-41ca-bfb1-abc9cf4d50d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:47 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Volume 85198273-320a-44b6-9001-bd9a01f17eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85198273-320a-44b6-9001-bd9a01f17eb5', 'volume_size': 1} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:47 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2c80343d-7b73-42d6-9c5c-9004dfd413c3 tempest-SnapshotsActionsTest-1603213423 None] Create snapshot completed successfully Feb 27 12:31:47 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 1073741824" returned: 0 in 0.652s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:47 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 Feb 27 12:31:47 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-a8ed76f4-70c2-4acb-b8bc-d01153e5655d-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-a8ed76f4-70c2-4acb-b8bc-d01153e5655d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-a8ed76f4-70c2-4acb-b8bc-d01153e5655d" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-a8ed76f4-70c2-4acb-b8bc-d01153e5655d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Deleting offline snapshot a8ed76f4-70c2-4acb-b8bc-d01153e5655d of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] snapshot_file for this snap is: volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9995648e-4b90-4cf7-9fda-c0ffe6bda662]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:48 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d Feb 27 12:31:48 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:48 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424" returned: 0 in 0.468s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-967527519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85198273-320a-44b6-9001-bd9a01f17eb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c769ca1151d4cb9ab3eb2fe6f1f88a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:47Z,use_quota=True,user_id='cf2d6420670a468ebf136ebe5c84fcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Creating volume 85198273-320a-44b6-9001-bd9a01f17eb5 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:48 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d24bd-8f7a-4d2d-b3e9-6ece69248345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda447ee-9378-4f2f-8fa8-90aa6c03f474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:48 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 1073741824 Feb 27 12:31:48 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:48 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Volume volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 (dd6d6cd1-c114-45f1-86c3-93a4363fa424): created successfully Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda447ee-9378-4f2f-8fa8-90aa6c03f474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Flow 'volume_create_manager' (1047d598-65e8-466c-82d9-3041e3a70925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:48 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-261633a4-1d81-4771-b7c5-ce60aa403d38 tempest-VolumesTransfersTest-1742582625 None] Created volume successfully. Feb 27 12:31:48 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d" returned: 0 in 0.650s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e5a549-e345-42d7-8fc5-4ab6331da2ab]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:48 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 1073741824" returned: 0 in 0.554s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:49 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:49 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:49 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 Feb 27 12:31:49 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Acquiring lock "cinder-dd6d6cd1-c114-45f1-86c3-93a4363fa424-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-dd6d6cd1-c114-45f1-86c3-93a4363fa424-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:49 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5" returned: 0 in 0.597s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:49 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.671s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:49 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f613eaf-347d-41ca-bfb1-abc9cf4d50d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85198273-320a-44b6-9001-bd9a01f17eb5', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:49 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c7ca54-4bea-418f-9f7b-7207270e8a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Acquiring lock "cinder-quobyte-dd6d6cd1-c114-45f1-86c3-93a4363fa424" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:49 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Volume volume-85198273-320a-44b6-9001-bd9a01f17eb5 (85198273-320a-44b6-9001-bd9a01f17eb5): created successfully Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c7ca54-4bea-418f-9f7b-7207270e8a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Flow 'volume_create_manager' (bcd621d0-1a09-4b3e-a8fc-e00dac9f387a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:UPDATE=153,cinder:SELECT=132,cinder:INSERT=34,cinder:DELETE=12 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-quobyte-dd6d6cd1-c114-45f1-86c3-93a4363fa424" acquired by "delete_volume" :: waited 0.024s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:49 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-7005f528-aea9-43ea-9edc-473a7274aa6a req-3459cf46-25f8-41bd-a039-b72d6b3bd21c tempest-VolumesGetTestJSON-662401384 None] Created volume successfully. Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=132,cinder:UPDATE=164,cinder:INSERT=39,cinder:DELETE=11 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25bab54-3105-470b-953d-30ee1ba6fe68]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:49 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 Feb 27 12:31:49 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:50 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d" returned: 0 in 0.613s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:50 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424" returned: 0 in 0.551s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:50 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d Feb 27 12:31:50 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:50 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424 Feb 27 12:31:50 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Acquiring lock "cinder-85198273-320a-44b6-9001-bd9a01f17eb5-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Lock "cinder-85198273-320a-44b6-9001-bd9a01f17eb5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:50 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.a8ed76f4-70c2-4acb-b8bc-d01153e5655d" returned: 0 in 0.492s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-a8ed76f4-70c2-4acb-b8bc-d01153e5655d" released by "_delete_snapshot" :: held 2.520s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" released by "delete_snapshot" :: held 2.555s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Acquiring lock "cinder-quobyte-85198273-320a-44b6-9001-bd9a01f17eb5" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Lock "cinder-quobyte-85198273-320a-44b6-9001-bd9a01f17eb5" acquired by "delete_volume" :: waited 0.020s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99828c-7868-48c9-a403-4e003882694d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Created reservations ['0dc16d13-b19e-4260-909d-65c758b50887', '747168e8-ca48-48fd-b2dc-819e7a5d2ea7', 'e0412eaf-dc5b-4768-8a68-723b5a886bd9', '146938a5-8858-4add-8762-6af38a3f4719'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:50 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Delete snapshot completed successfully. Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-37d2e679-4625-47e8-9d47-ff33d7fef3fb tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-a8ed76f4-70c2-4acb-b8bc-d01153e5655d-delete_snapshot" released by "delete_snapshot" :: held 2.782s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:50 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dd6d6cd1-c114-45f1-86c3-93a4363fa424" returned: 0 in 0.755s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-quobyte-dd6d6cd1-c114-45f1-86c3-93a4363fa424" released by "delete_volume" :: held 1.335s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:51 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 Feb 27 12:31:51 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Created reservations ['d7e9869c-ac0c-4a4c-ac9b-95efca20b081', '4458bbb4-1cc1-4834-9ec9-cc6b4d0aa802', '54f44d9c-b873-47d2-b4f3-5c8c317f02ba', '98c3c633-d350-4860-9664-6def07bdfda4'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:51 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:51 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:51 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5" returned: 0 in 0.675s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:51 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5 Feb 27 12:31:51 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:51 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.500s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:51 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Deleted volume successfully. Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Creating offline snapshot edaee540-08f4-4ae2-bc31-bc4c12b598be of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec77450-6995-4bc1-8d6c-8daab1b41143]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-42d7e787-1fa4-4973-a840-2a0e577eccf3 tempest-VolumesTransfersTest-1663182453 None] Lock "cinder-dd6d6cd1-c114-45f1-86c3-93a4363fa424-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:51 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:51 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:52 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-85198273-320a-44b6-9001-bd9a01f17eb5" returned: 0 in 0.618s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Lock "cinder-quobyte-85198273-320a-44b6-9001-bd9a01f17eb5" released by "delete_volume" :: held 1.334s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG cinder.quota [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Created reservations ['9e7f85cb-e2cf-44d4-ae55-c3af5e6f3581', '5e72f5ac-c94a-48d6-9396-f558c043361b', '2cdae389-7712-4aad-a3a7-a09d644f33b2', '0b83969f-2382-4e54-aeb1-f63d75775e44'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:52 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.602s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:52 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be 1G Feb 27 12:31:52 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:52 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:31:52 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:52 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.536s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG cinder.manager [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:31:52 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Deleted volume successfully. Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-6d8e7a8c-8101-4228-a275-960fe6cbae11 req-187e1646-f3cf-4952-bf83-e6a074613b03 tempest-VolumesGetTestJSON-662401384 None] Lock "cinder-85198273-320a-44b6-9001-bd9a01f17eb5-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:52 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be 1G" returned: 0 in 0.691s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:52 devstack sudo[85886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be Feb 27 12:31:52 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:53 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be" returned: 0 in 0.594s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:53 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be is being set with open permissions: ugo+rw Feb 27 12:31:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:53 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be Feb 27 12:31:53 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:54 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be" returned: 0 in 0.501s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:54 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-79935c9c-d9a5-4db2-9809-1a44e3fd02e0 tempest-SnapshotsActionsTest-1603213423 None] Create snapshot completed successfully Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-edaee540-08f4-4ae2-bc31-bc4c12b598be-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-edaee540-08f4-4ae2-bc31-bc4c12b598be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-edaee540-08f4-4ae2-bc31-bc4c12b598be" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-edaee540-08f4-4ae2-bc31-bc4c12b598be" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Deleting offline snapshot edaee540-08f4-4ae2-bc31-bc4c12b598be of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] snapshot_file for this snap is: volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ab351-62e2-484c-9fd0-7ba04eb472d3]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:54 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be Feb 27 12:31:54 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:55 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be" returned: 0 in 0.737s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:55 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc9db8f-d29b-49a6-9ab0-be60cba7db97]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:55 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:55 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:56 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.595s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:56 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be Feb 27 12:31:56 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:56 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be" returned: 0 in 0.639s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:56 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be Feb 27 12:31:56 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Flow 'volume_create_manager' (a0bc6392-6a28-4674-a241-5c271d864a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ab3502-5a5c-49dd-989f-329bafbcaa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ab3502-5a5c-49dd-989f-329bafbcaa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-655756378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e7fd061b204bc794925b4157f7065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:57Z,use_quota=True,user_id='01051941c2d24f9fbb637ff64947ba66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b0ad1b-b15d-4cee-8ec5-57758cfad2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b0ad1b-b15d-4cee-8ec5-57758cfad2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1943c53e-3709-4c04-9555-ae5033b3b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1943c53e-3709-4c04-9555-ae5033b3b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b', 'volume_name': 'volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de21e631-b0e4-413b-8a3a-d4f613d324d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de21e631-b0e4-413b-8a3a-d4f613d324d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afb3cc4-70f3-4385-9204-c934bcb22750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:57 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Volume 6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b', 'volume_size': 1} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-655756378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e7fd061b204bc794925b4157f7065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:31:57Z,use_quota=True,user_id='01051941c2d24f9fbb637ff64947ba66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Creating volume 6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:31:57 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:57 devstack sudo[85944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b 1073741824 Feb 27 12:31:57 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:57 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.edaee540-08f4-4ae2-bc31-bc4c12b598be" returned: 0 in 0.544s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-edaee540-08f4-4ae2-bc31-bc4c12b598be" released by "_delete_snapshot" :: held 2.615s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" released by "delete_snapshot" :: held 2.633s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Created reservations ['8ca5d67f-72bc-4cac-b916-6e5de0598f95', 'e5e6bae8-950f-4627-94e0-9e0d5f81a590', '1d9d3bbb-ccea-4b14-90b7-def1641f92bf', 'd3a9a10d-887b-4193-a99d-c706633eac99'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:31:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Delete snapshot completed successfully. Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dbf3e1d6-78af-4efa-a748-44eba13ff532 tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-edaee540-08f4-4ae2-bc31-bc4c12b598be-delete_snapshot" released by "delete_snapshot" :: held 2.766s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:31:57 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b 1073741824" returned: 0 in 0.682s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:57 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b Feb 27 12:31:57 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:31:58 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b" returned: 0 in 0.606s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.357s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Creating offline snapshot c3634b39-1c65-45b6-925f-bb66a809ef5b of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afb3cc4-70f3-4385-9204-c934bcb22750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f55cf9-d653-40dc-b521-03a30f77837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dd884c-0893-493f-8759-f355cfe11caf]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:58 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Volume volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b (6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b): created successfully Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f55cf9-d653-40dc-b521-03a30f77837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:31:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Flow 'volume_create_manager' (a0bc6392-6a28-4674-a241-5c271d864a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:31:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-873c710e-5a41-45b5-bc80-945edbef7a72 tempest-VolumesTransfersV357Test-20339286 None] Created volume successfully. Feb 27 12:31:58 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:31:58 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8f2ef9f2-7316-454e-a4f0-d40ed83e4668 tempest-GroupSnapshotsV319Test-1962690767 None] Group tempest-GroupSnapshotsV319Test-Group-470451784: creating Feb 27 12:31:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8f2ef9f2-7316-454e-a4f0-d40ed83e4668 tempest-GroupSnapshotsV319Test-1962690767 None] Group tempest-GroupSnapshotsV319Test-Group-470451784: created successfully Feb 27 12:31:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8f2ef9f2-7316-454e-a4f0-d40ed83e4668 tempest-GroupSnapshotsV319Test-1962690767 None] Create group completed successfully. Feb 27 12:31:59 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.596s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:31:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:59 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b 1G Feb 27 12:31:59 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:31:59 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Feb 27 12:31:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b 1G" returned: 0 in 0.523s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:31:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:31:59 devstack sudo[85970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b Feb 27 12:31:59 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-fb4be049-551f-412b-8c9b-e79364e57833 tempest-VolumesTransfersV357Test-1645068824 None] Transfer volume completed successfully. Feb 27 12:31:59 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:00 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b" returned: 0 in 0.435s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:00 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b is being set with open permissions: ugo+rw Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:00 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b Feb 27 12:32:00 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Flow 'volume_create_manager' (6ed47750-b485-47b4-812d-b66892481e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687ef0bd-daef-458f-9736-93bfa28bcaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687ef0bd-daef-458f-9736-93bfa28bcaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-226885907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c425a35e-2d52-4ad6-977c-8202e2bfc0f9,host='devstack@QuobyteHD#QuobyteHD',id=d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62702af94b3a418da4d0e0cca288ec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:00Z,use_quota=True,user_id='9c855bd9cbe24ba3830663cc84324a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5eac192-50fc-4eea-b768-a803883d1ec5),volume_type_id=d5eac192-50fc-4eea-b768-a803883d1ec5)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0644c9-c6d2-4633-9f60-0318f9c3d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0644c9-c6d2-4633-9f60-0318f9c3d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0be48c-97a0-4fd9-9fa3-fa9d020f5d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0be48c-97a0-4fd9-9fa3-fa9d020f5d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3177e4b-fc90-4b76-8c71-4b1e4a4a3daa', 'volume_name': 'volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d89432-022b-4bf2-9910-7ead93751d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d89432-022b-4bf2-9910-7ead93751d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476ef3f0-805b-4ec3-93f1-461f8333b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:00 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Volume d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa', 'volume_size': 1} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Acquiring lock "cinder-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:00 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b" returned: 0 in 0.495s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.234s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c425a35e-2d52-4ad6-977c-8202e2bfc0f9,created_at=2026-02-27T11:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-226885907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c425a35e-2d52-4ad6-977c-8202e2bfc0f9,host='devstack@QuobyteHD#QuobyteHD',id=d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62702af94b3a418da4d0e0cca288ec16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:00Z,use_quota=True,user_id='9c855bd9cbe24ba3830663cc84324a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5eac192-50fc-4eea-b768-a803883d1ec5),volume_type_id=d5eac192-50fc-4eea-b768-a803883d1ec5)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Creating volume d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:00 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:00 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa 1073741824 Feb 27 12:32:00 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:00 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b739d18a-1789-4151-a4a2-1dbbca1360d4 tempest-SnapshotsActionsTest-1603213423 None] Create snapshot completed successfully Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Acquiring lock "cinder-quobyte-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-quobyte-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f080a0a-3129-41b3-af3b-681827d1d905]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:00 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b Feb 27 12:32:00 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:01 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa 1073741824" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:01 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa Feb 27 12:32:01 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:01 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b" returned: 0 in 0.606s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:01 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b Feb 27 12:32:01 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-c3634b39-1c65-45b6-925f-bb66a809ef5b-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-c3634b39-1c65-45b6-925f-bb66a809ef5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Acquiring lock "cinder-quobyte-c3634b39-1c65-45b6-925f-bb66a809ef5b" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-c3634b39-1c65-45b6-925f-bb66a809ef5b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Deleting offline snapshot c3634b39-1c65-45b6-925f-bb66a809ef5b of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] snapshot_file for this snap is: volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56b17c8-a691-44c2-88aa-6e61bda70346]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:01 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b Feb 27 12:32:01 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:01 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" returned: 0 in 0.697s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476ef3f0-805b-4ec3-93f1-461f8333b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e97b2b-ac43-4a2b-aa4f-9e929d371e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:01 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Volume volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa (d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa): created successfully Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e97b2b-ac43-4a2b-aa4f-9e929d371e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Flow 'volume_create_manager' (6ed47750-b485-47b4-812d-b66892481e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:02 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5e6fe0e0-10fd-471c-a4aa-5090ab50d1cf tempest-GroupSnapshotsV319Test-1962690767 None] Created volume successfully. Feb 27 12:32:02 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b" returned: 0 in 0.720s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-quobyte-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b" released by "delete_volume" :: held 1.350s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Created reservations ['fa51ab54-c8c9-4686-8328-7c94bcdec1e3', 'bdbbddaf-444f-4911-84e1-d1915c1f18f7', 'a01235ac-51f5-4a22-9efc-2c2279478670', 'd4669e72-96a1-49d3-8fc8-bd41c6980c58'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:02 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:02 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:02 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b" returned: 0 in 0.817s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3fd041-52c5-4313-9f86-5409f4e31842]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:02 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:32:02 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:02 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] GroupSnapshot 477b19e2-5064-4059-a5e3-598645d19588: creating. Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Group snapshot 477b19e2-5064-4059-a5e3-598645d19588: creating. {{(pid=83114) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Creating offline snapshot 36adb49e-e0c4-44b9-a831-f96da3f69cff of volume d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[68acf305-b0a4-42e0-a7da-2c7a5645e21d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:03 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa Feb 27 12:32:03 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:03 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.973s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:03 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Deleted volume successfully. Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4cf2b626-dbf9-4b0b-be3b-7ad2f5ad414b tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-6a1af15e-450d-4d96-a6f9-a6b4f5b5f37b-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Flow 'volume_create_manager' (c6de5eb7-a13f-4c67-a905-428a9718e276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee898a67-9e51-40be-89ee-87f28862d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee898a67-9e51-40be-89ee-87f28862d81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-480166939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ccc760-05ab-45db-ba0c-dc8264005aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e7fd061b204bc794925b4157f7065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:03Z,use_quota=True,user_id='01051941c2d24f9fbb637ff64947ba66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d76e69-e943-42e6-8a19-68fbab1a5f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d76e69-e943-42e6-8a19-68fbab1a5f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9e277-3e9f-49e7-a474-0ce298b5ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9e277-3e9f-49e7-a474-0ce298b5ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ccc760-05ab-45db-ba0c-dc8264005aa1', 'volume_name': 'volume-72ccc760-05ab-45db-ba0c-dc8264005aa1', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2531f2-b368-4829-9db9-185d69e1242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2531f2-b368-4829-9db9-185d69e1242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2771b44-5696-4c8e-b7eb-195f7b88567d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:03 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Volume 72ccc760-05ab-45db-ba0c-dc8264005aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ccc760-05ab-45db-ba0c-dc8264005aa1', 'volume_size': 1} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:03 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 1.171s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:03 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b Feb 27 12:32:03 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:03 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" returned: 0 in 0.829s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:03 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff 1G Feb 27 12:32:03 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:04 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b" returned: 0 in 0.607s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:04 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b Feb 27 12:32:04 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:04 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff 1G" returned: 0 in 0.585s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:04 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff Feb 27 12:32:04 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:04 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.c3634b39-1c65-45b6-925f-bb66a809ef5b" returned: 0 in 0.516s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-c3634b39-1c65-45b6-925f-bb66a809ef5b" released by "_delete_snapshot" :: held 3.257s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" released by "delete_snapshot" :: held 3.270s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Created reservations ['8c182554-cfdb-4032-b5dd-13eea8a77fcc', '970261f2-fe4d-49e6-b776-e126ea738564', 'ed6c9a2f-efae-4b34-b6a9-707f6bdaca48', '233126d7-4f8e-4cd2-a40f-09d9b9cf25d4'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:04 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Delete snapshot completed successfully. Feb 27 12:32:04 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fc595e5a-afac-40bb-b70d-84ed25c7bfaf tempest-SnapshotsActionsTest-933977446 None] Lock "cinder-c3634b39-1c65-45b6-925f-bb66a809ef5b-delete_snapshot" released by "delete_snapshot" :: held 3.399s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:05 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff" returned: 0 in 0.723s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:05 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:32:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:05 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff Feb 27 12:32:05 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:05 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff" returned: 0 in 0.532s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:05 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.info Feb 27 12:32:05 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "cinder-e2a16831-32c9-4371-8c23-d45887e47d9d-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-e2a16831-32c9-4371-8c23-d45887e47d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "cinder-quobyte-e2a16831-32c9-4371-8c23-d45887e47d9d" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-quobyte-e2a16831-32c9-4371-8c23-d45887e47d9d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Deleting offline snapshot e2a16831-32c9-4371-8c23-d45887e47d9d of volume 9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] snapshot_file for this snap is: volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea0d02b-7416-466c-88bd-a4961f745f4a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:06 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.info" returned: 0 in 0.680s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:06 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:06 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:32:06 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:06 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.info Feb 27 12:32:06 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:06 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.631s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93056b0-28c3-49a7-9eb6-dfeee1f21d5c]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:06 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.info" returned: 0 in 0.639s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.077s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.496s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-480166939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ccc760-05ab-45db-ba0c-dc8264005aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e7fd061b204bc794925b4157f7065d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:03Z,use_quota=True,user_id='01051941c2d24f9fbb637ff64947ba66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Creating volume 72ccc760-05ab-45db-ba0c-dc8264005aa1 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:07 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:07 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c Feb 27 12:32:07 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:07 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 1073741824 Feb 27 12:32:07 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:07 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3f947c7e-94d8-4dfd-a610-b0e571b0600e tempest-GroupSnapshotsV319Test-1962690767 None] group_snapshot 477b19e2-5064-4059-a5e3-598645d19588: created successfully Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:07 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:07 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:07 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c" returned: 0 in 0.585s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:07 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:32:07 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:07 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 1073741824" returned: 0 in 0.668s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:07 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 Feb 27 12:32:07 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:07 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.601s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:07 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:08 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.606s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:08 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d Feb 27 12:32:08 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:08 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1" returned: 0 in 0.549s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2771b44-5696-4c8e-b7eb-195f7b88567d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ccc760-05ab-45db-ba0c-dc8264005aa1', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44732424-4198-4eca-8123-e72c50e1d3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:08 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Volume volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 (72ccc760-05ab-45db-ba0c-dc8264005aa1): created successfully Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44732424-4198-4eca-8123-e72c50e1d3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Flow 'volume_create_manager' (c6de5eb7-a13f-4c67-a905-428a9718e276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6cef4408-869c-4c11-9955-36ff5d26007a tempest-VolumesTransfersV357Test-20339286 None] Created volume successfully. Feb 27 12:32:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] group_snapshot 477b19e2-5064-4059-a5e3-598645d19588: deleting Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] group_snapshot 477b19e2-5064-4059-a5e3-598645d19588: deleting {{(pid=83114) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Acquiring lock "cinder-quobyte-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "cinder-quobyte-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Acquiring lock "cinder-quobyte-36adb49e-e0c4-44b9-a831-f96da3f69cff" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "cinder-quobyte-36adb49e-e0c4-44b9-a831-f96da3f69cff" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Deleting offline snapshot 36adb49e-e0c4-44b9-a831-f96da3f69cff of volume d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] snapshot_file for this snap is: volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3e07a2-f62f-4080-a99b-d43339eb5827]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:08 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff Feb 27 12:32:08 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:08 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c.e2a16831-32c9-4371-8c23-d45887e47d9d" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-quobyte-e2a16831-32c9-4371-8c23-d45887e47d9d" released by "_delete_snapshot" :: held 2.436s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" released by "delete_snapshot" :: held 2.460s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Created reservations ['86b2f186-bee9-47b4-85a9-143b4d352bdd', '444bd5a8-ef16-44b0-8900-ec39245d7f88', 'c381dc74-78bf-4bad-a163-1419c679fe46', '06af139a-5c50-4477-b2b1-f73d8f7dc89d'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Delete snapshot completed successfully. Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abd15e80-dd8d-4c5f-8f81-86962b096867 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-e2a16831-32c9-4371-8c23-d45887e47d9d-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Acquiring lock "cinder-72ccc760-05ab-45db-ba0c-dc8264005aa1-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-72ccc760-05ab-45db-ba0c-dc8264005aa1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Acquiring lock "cinder-quobyte-72ccc760-05ab-45db-ba0c-dc8264005aa1" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-quobyte-72ccc760-05ab-45db-ba0c-dc8264005aa1" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe2ec83-17f2-4b22-98b5-43f79d6295e5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:09 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 Feb 27 12:32:09 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:09 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff" returned: 0 in 0.581s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d21d7-2546-4ce4-ae3a-1ca15022b5a0]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:09 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa Feb 27 12:32:09 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "cinder-9283dd39-f408-48c4-8c2f-a58f503c8b9c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-9283dd39-f408-48c4-8c2f-a58f503c8b9c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd889662-01d2-4790-851c-542efcaa78f8]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:09 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1" returned: 0 in 0.574s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:09 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1 Feb 27 12:32:09 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:09 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c Feb 27 12:32:09 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:09 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" returned: 0 in 0.545s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:09 devstack sudo[86240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff Feb 27 12:32:09 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:10 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-72ccc760-05ab-45db-ba0c-dc8264005aa1" returned: 0 in 0.518s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-quobyte-72ccc760-05ab-45db-ba0c-dc8264005aa1" released by "delete_volume" :: held 1.137s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Created reservations ['9b243a8d-ec8d-45a0-9e9e-1f6867f0dbcc', 'eb7c8a14-4167-48f1-9717-8600ac8a76f4', '03b6328f-54c5-455e-9e80-afbfbe35c3dd', 'e537a4b0-9fdc-4814-9c32-ac012d6c0d3f'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:10 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c" returned: 0 in 0.644s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:10 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c Feb 27 12:32:10 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:10 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff" returned: 0 in 0.549s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:10 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:10 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:10 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff Feb 27 12:32:10 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:10 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa.36adb49e-e0c4-44b9-a831-f96da3f69cff" returned: 0 in 0.438s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.486s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "cinder-quobyte-36adb49e-e0c4-44b9-a831-f96da3f69cff" released by "_delete_snapshot" :: held 2.206s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Deleted volume successfully. Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9283dd39-f408-48c4-8c2f-a58f503c8b9c" returned: 0 in 0.561s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "cinder-quobyte-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" released by "delete_snapshot" :: held 2.234s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-quobyte-9283dd39-f408-48c4-8c2f-a58f503c8b9c" released by "delete_volume" :: held 1.267s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-561980b5-4b96-4b72-a12b-cbf7d925ac69 tempest-VolumesTransfersV357Test-1256193670 None] Lock "cinder-72ccc760-05ab-45db-ba0c-dc8264005aa1-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:10 devstack cinder-volume[83114]: WARNING cinder.quota [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-540138824 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-540138824, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:10 devstack cinder-volume[83114]: WARNING cinder.quota [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-540138824 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-540138824, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Created reservations ['c472a3a6-7bb4-4773-9a54-b94cb13f35a5', 'dc1203eb-2854-4731-b539-0f8758cb0488', 'a62d313c-cd68-4f2a-9508-b14ba34f7a6c', '63b87be5-d968-4739-9ef0-53fb552737ce'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] Created reservations ['36ffa97a-e5cf-4868-b6eb-5eaa2f7eb88f', 'a346a26e-8f14-432c-92be-33904a64962c', '2c627643-daab-4835-854c-16f18de2feeb', 'dca3f337-d4c2-4546-bad7-f3b3463ea18e'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-de8e98eb-acca-45ce-bb18-435cfd12e05a tempest-GroupSnapshotsV319Test-1962690767 None] group_snapshot 477b19e2-5064-4059-a5e3-598645d19588: deleted successfully Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:10 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:10 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:11 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.455s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:11 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Deleted volume successfully. Feb 27 12:32:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bbd6127-f904-40dd-a12d-aad50aad19a3 tempest-SnapshotsActionsTest-1603213423 None] Lock "cinder-9283dd39-f408-48c4-8c2f-a58f503c8b9c-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Acquiring lock "cinder-quobyte-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "cinder-quobyte-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:11 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c1c619-dd3c-4682-bbed-e21efb50a7a2]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:12 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa Feb 27 12:32:12 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:12 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" returned: 0 in 0.642s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:12 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa Feb 27 12:32:12 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:13 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" returned: 0 in 0.548s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "cinder-quobyte-d3177e4b-fc90-4b76-8c71-4b1e4a4a3daa" released by "delete_volume" :: held 1.231s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Created reservations ['926d026b-c3aa-475c-97fc-2d09b200f32e'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:13 devstack cinder-volume[83114]: WARNING cinder.quota [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-540138824 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-540138824, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Created reservations ['e2cca973-d6bd-4bdf-b337-31228b71cd45', '7c7e9279-3d99-4400-8544-fbb4a0a46ed7', '79b2c73d-0331-4079-adce-c9ed61d46267', 'f1732737-284c-4c86-a570-d0208856abd6'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:13 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:13 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:13 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:13 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:13 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-af0dbdda-ceae-4b93-bede-2e195ec8df4a tempest-GroupSnapshotsV319Test-1962690767 None] Delete group completed successfully. Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Flow 'volume_create_manager' (c4cb3717-b49f-47f8-a9c4-d1fa979d31fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea13163-51bb-4a4a-9c8d-4dabb62837f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea13163-51bb-4a4a-9c8d-4dabb62837f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-483045054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c931563-e205-48a7-b0fa-304b8082cf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2449d468b5854dc18cfb6ff6e387533a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='7ff12332b4d24c8ba6bfa66f10fd6137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26b8b34-a437-42f2-a512-44fee8b60ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26b8b34-a437-42f2-a512-44fee8b60ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6b7259-9f8b-44dc-9594-0c0aa111660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6b7259-9f8b-44dc-9594-0c0aa111660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c931563-e205-48a7-b0fa-304b8082cf73', 'volume_name': 'volume-4c931563-e205-48a7-b0fa-304b8082cf73', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4903f5bf-c8eb-486d-9f0a-0155da0c9628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4903f5bf-c8eb-486d-9f0a-0155da0c9628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc83a75-3f71-439b-baa6-adc1cd8d89bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:16 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Volume 4c931563-e205-48a7-b0fa-304b8082cf73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c931563-e205-48a7-b0fa-304b8082cf73', 'volume_size': 1} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-483045054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c931563-e205-48a7-b0fa-304b8082cf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2449d468b5854dc18cfb6ff6e387533a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:16Z,use_quota=True,user_id='7ff12332b4d24c8ba6bfa66f10fd6137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Creating volume 4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:16 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:16 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 1073741824 Feb 27 12:32:16 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:16 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 1073741824" returned: 0 in 0.636s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:17 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 Feb 27 12:32:17 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:17 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73" returned: 0 in 0.520s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc83a75-3f71-439b-baa6-adc1cd8d89bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c931563-e205-48a7-b0fa-304b8082cf73', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24165063-0bb1-4808-9352-234b9a6c8f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:17 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Volume volume-4c931563-e205-48a7-b0fa-304b8082cf73 (4c931563-e205-48a7-b0fa-304b8082cf73): created successfully Feb 27 12:32:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24165063-0bb1-4808-9352-234b9a6c8f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Flow 'volume_create_manager' (c4cb3717-b49f-47f8-a9c4-d1fa979d31fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:17 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9320430d-cf1e-430f-99a6-ff8bb7459bd8 tempest-VolumesCloneTest-1496467207 None] Created volume successfully. Feb 27 12:32:18 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-09317406-35c8-45c5-90be-4a9da109e733 tempest-GroupsTest-686896531 None] Group tempest-Group1-328719030: creating Feb 27 12:32:18 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-09317406-35c8-45c5-90be-4a9da109e733 tempest-GroupsTest-686896531 None] Group tempest-Group1-328719030: created successfully Feb 27 12:32:18 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-09317406-35c8-45c5-90be-4a9da109e733 tempest-GroupsTest-686896531 None] Create group completed successfully. Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Flow 'volume_create_manager' (357e4210-0c12-4ab6-8295-8bb78f759fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f45e981-1ee8-44ec-840a-eba06ff00600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f45e981-1ee8-44ec-840a-eba06ff00600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1514460458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc8ee26-f512-4a0d-a132-b8f53069f4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2449d468b5854dc18cfb6ff6e387533a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4c931563-e205-48a7-b0fa-304b8082cf73,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:19Z,use_quota=True,user_id='7ff12332b4d24c8ba6bfa66f10fd6137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfb8a47-75f5-4d69-a051-1d84b8ec8209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfb8a47-75f5-4d69-a051-1d84b8ec8209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fd18a6-31ff-4626-98e4-efaf87a7f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fd18a6-31ff-4626-98e4-efaf87a7f128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2bc8ee26-f512-4a0d-a132-b8f53069f4fc', 'volume_name': 'volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc', 'volume_size': 2, 'source_volid': '4c931563-e205-48a7-b0fa-304b8082cf73', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8daba9c2-9509-4102-add4-444fe4fc4281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8daba9c2-9509-4102-add4-444fe4fc4281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac28ad2-f52b-46ce-83ff-2ce4e2f0f4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Volume 2bc8ee26-f512-4a0d-a132-b8f53069f4fc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc', 'volume_size': 2, 'source_volid': '4c931563-e205-48a7-b0fa-304b8082cf73', 'source_volstatus': 'available'} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:18 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Cloning volume 4c931563-e205-48a7-b0fa-304b8082cf73 to volume 2bc8ee26-f512-4a0d-a132-b8f53069f4fc Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Creating offline snapshot 66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 of volume 4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[469dd0ce-6306-45b5-88bf-5913c5b31009]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:18 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 Feb 27 12:32:18 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ad8249dc-c88f-4c6d-bce0-5ad839856abb tempest-GroupsTest-686896531 None] Group tempest-Group2-177108586: creating Feb 27 12:32:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ad8249dc-c88f-4c6d-bce0-5ad839856abb tempest-GroupsTest-686896531 None] Group tempest-Group2-177108586: created successfully Feb 27 12:32:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ad8249dc-c88f-4c6d-bce0-5ad839856abb tempest-GroupsTest-686896531 None] Create group completed successfully. Feb 27 12:32:19 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73" returned: 0 in 0.647s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:19 devstack sudo[86334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 1G Feb 27 12:32:19 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:20 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 1G" returned: 0 in 0.716s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c931563-e205-48a7-b0fa-304b8082cf73 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:20 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c931563-e205-48a7-b0fa-304b8082cf73 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 Feb 27 12:32:20 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:20 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c931563-e205-48a7-b0fa-304b8082cf73 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" returned: 0 in 0.597s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:20 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 is being set with open permissions: ugo+rw Feb 27 12:32:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:20 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 Feb 27 12:32:20 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Flow 'volume_create_manager' (fc849718-cf5b-4820-b01b-d1aa2003f736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f676eb-deb0-46ab-8abb-4395cec15728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f676eb-deb0-46ab-8abb-4395cec15728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505632576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82fcf999-3556-402d-b83f-b3df2571989c,host='devstack@QuobyteHD#QuobyteHD',id=b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46f6e3ed8a84d5b9cf2aa04b12fa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:21Z,use_quota=True,user_id='d135176f9b9a4d9ba76b769cead344a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ac2b046-d9e8-4d88-870b-3a4aefb0d5b2),volume_type_id=6ac2b046-d9e8-4d88-870b-3a4aefb0d5b2)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13369881-dedf-411a-837e-8ba41c8fb389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13369881-dedf-411a-837e-8ba41c8fb389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5c6527-7898-4f44-ba7b-45e4947db4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5c6527-7898-4f44-ba7b-45e4947db4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad', 'volume_name': 'volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae6cbe0-cead-4ebb-94f4-088b97bca95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae6cbe0-cead-4ebb-94f4-088b97bca95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218e5c46-454e-48b6-8e01-aba11125a230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Volume b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad', 'volume_size': 1} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:21 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" returned: 0 in 0.595s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:21 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.info Feb 27 12:32:21 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Flow 'volume_create_manager' (e64a9023-18e5-49ce-a171-8399877ccd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8952ca3d-dfab-42f4-b993-338fc2ddbe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8952ca3d-dfab-42f4-b993-338fc2ddbe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-546973682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346d3b41-4b93-42ea-b01b-3005f697d8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6065766a8c8c42f091eeee808b13c489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:21Z,use_quota=True,user_id='5e1da0f2bf8f422b933ba087d31d3597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a68f609-4f17-46d8-8da5-5c9522180c80),volume_type_id=9a68f609-4f17-46d8-8da5-5c9522180c80)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a3296f-91dd-4545-8311-4ccaa528dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a3296f-91dd-4545-8311-4ccaa528dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93915a8-e6bd-4903-9041-7cf911ea5d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93915a8-e6bd-4903-9041-7cf911ea5d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '346d3b41-4b93-42ea-b01b-3005f697d8d5', 'volume_name': 'volume-346d3b41-4b93-42ea-b01b-3005f697d8d5', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a88fdb-1d59-41d6-9196-a075bc7572ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a88fdb-1d59-41d6-9196-a075bc7572ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198f9946-e679-4b1c-9320-583db030b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Volume 346d3b41-4b93-42ea-b01b-3005f697d8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-346d3b41-4b93-42ea-b01b-3005f697d8d5', 'volume_size': 1} Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:21 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.info" returned: 0 in 0.495s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:21 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.info is being set with open permissions: ugo+rw Feb 27 12:32:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:21 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.info Feb 27 12:32:21 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:22 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.info" returned: 0 in 0.502s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Acquiring lock "cinder-quobyte-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] snapshot: 66fdc6cd-669e-4ff3-ba8c-ee738995a2d8, volume: 2bc8ee26-f512-4a0d-a132-b8f53069f4fc, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09eaa37-b40d-4281-aae2-622ebff519e3]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:22 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 Feb 27 12:32:22 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:22 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" returned: 0 in 0.556s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c931563-e205-48a7-b0fa-304b8082cf73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f16d888-c987-4546-83e3-08475d2e8d25]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:23 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 Feb 27 12:32:23 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:23 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73" returned: 0 in 0.577s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:23 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:32:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:23 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc Feb 27 12:32:23 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:26 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" returned: 0 in 2.718s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:26 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4950d85e-0a59-4c06-95f6-1a615f0b6d7f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:26 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 Feb 27 12:32:26 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:26 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73" returned: 0 in 0.672s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:26 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:32:26 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Converted 1024.00 MB image at 376.55 MB/s Feb 27 12:32:26 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc is being set with open permissions: ugo+rw Feb 27 12:32:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:26 devstack sudo[86407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc Feb 27 12:32:26 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:27 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" returned: 0 in 0.422s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" released by "_copy_volume_from_snapshot" :: held 5.007s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Acquiring lock "cinder-quobyte-66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Deleting offline snapshot 66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 of volume 4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] snapshot_file for this snap is: volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab60ff54-7561-468c-add9-74dbcbcec913]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:27 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 Feb 27 12:32:27 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:27 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" returned: 0 in 0.552s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c931563-e205-48a7-b0fa-304b8082cf73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:32:28 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f41b910-30d1-46f7-8188-d51c03143206]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:28 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 Feb 27 12:32:28 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:28 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73" returned: 0 in 0.539s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:28 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 Feb 27 12:32:28 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:29 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" returned: 0 in 0.565s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:29 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8 Feb 27 12:32:29 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:29 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73.66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" returned: 0 in 0.452s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-66fdc6cd-669e-4ff3-ba8c-ee738995a2d8" released by "_delete_snapshot" :: held 2.173s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.873s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.546s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=82fcf999-3556-402d-b83f-b3df2571989c,created_at=2026-02-27T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505632576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82fcf999-3556-402d-b83f-b3df2571989c,host='devstack@QuobyteHD#QuobyteHD',id=b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46f6e3ed8a84d5b9cf2aa04b12fa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:21Z,use_quota=True,user_id='d135176f9b9a4d9ba76b769cead344a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ac2b046-d9e8-4d88-870b-3a4aefb0d5b2),volume_type_id=6ac2b046-d9e8-4d88-870b-3a4aefb0d5b2)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Creating volume b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:29 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac28ad2-f52b-46ce-83ff-2ce4e2f0f4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc', 'volume_size': 2, 'source_volid': '4c931563-e205-48a7-b0fa-304b8082cf73', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987b6515-7c98-4c25-bc50-a18296f17e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:29 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad 1073741824 Feb 27 12:32:29 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:29 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Volume volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc (2bc8ee26-f512-4a0d-a132-b8f53069f4fc): created successfully Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987b6515-7c98-4c25-bc50-a18296f17e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Flow 'volume_create_manager' (357e4210-0c12-4ab6-8295-8bb78f759fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d0623c3b-45f7-4d4a-821b-8cd5f66a00b7 tempest-VolumesCloneTest-1496467207 None] Created volume successfully. Feb 27 12:32:30 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad 1073741824" returned: 0 in 0.606s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:30 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad Feb 27 12:32:30 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Acquiring lock "cinder-2bc8ee26-f512-4a0d-a132-b8f53069f4fc-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Lock "cinder-2bc8ee26-f512-4a0d-a132-b8f53069f4fc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Acquiring lock "cinder-quobyte-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ca7a3e-8ced-45ef-81c1-43a6b293b0e8]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:30 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad" returned: 0 in 0.538s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.217s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-546973682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346d3b41-4b93-42ea-b01b-3005f697d8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6065766a8c8c42f091eeee808b13c489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:21Z,use_quota=True,user_id='5e1da0f2bf8f422b933ba087d31d3597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a68f609-4f17-46d8-8da5-5c9522180c80),volume_type_id=9a68f609-4f17-46d8-8da5-5c9522180c80)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Creating volume 346d3b41-4b93-42ea-b01b-3005f697d8d5 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:30 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218e5c46-454e-48b6-8e01-aba11125a230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b68eb-f2ff-492c-ba19-ee114d9b642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:30 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 1073741824 Feb 27 12:32:30 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Volume volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad (b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad): created successfully Feb 27 12:32:30 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b68eb-f2ff-492c-ba19-ee114d9b642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Flow 'volume_create_manager' (fc849718-cf5b-4820-b01b-d1aa2003f736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:30 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc Feb 27 12:32:30 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b4cf2766-7861-4e43-86fd-24780727a19b tempest-GroupsTest-686896531 None] Created volume successfully. Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Acquiring lock "cinder-quobyte-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:31 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" returned: 0 in 0.834s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Lock "cinder-quobyte-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad" acquired by "delete_volume" :: waited 0.036s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:31 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc Feb 27 12:32:31 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebe57c7-a7e9-40f6-908b-205690547353]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:31 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 1073741824" returned: 0 in 0.834s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:31 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 Feb 27 12:32:31 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:31 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad Feb 27 12:32:31 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:32 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5" returned: 0 in 0.493s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198f9946-e679-4b1c-9320-583db030b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-346d3b41-4b93-42ea-b01b-3005f697d8d5', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5e9489-8077-4367-be7f-f2081f1976a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:32 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Volume volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 (346d3b41-4b93-42ea-b01b-3005f697d8d5): created successfully Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5e9489-8077-4367-be7f-f2081f1976a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Flow 'volume_create_manager' (e64a9023-18e5-49ce-a171-8399877ccd4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:32 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ea86a3fc-2513-41f0-a275-d9697bb5fa75 tempest-VolumeTypesAccessTest-176275294 None] Created volume successfully. Feb 27 12:32:32 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" returned: 0 in 0.631s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-2bc8ee26-f512-4a0d-a132-b8f53069f4fc" released by "delete_volume" :: held 1.501s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad" returned: 0 in 0.612s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:32 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad Feb 27 12:32:32 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Created reservations ['19d5b36c-8a6b-493c-9947-3bb3a0b2490f', '5318fcaf-7c0d-497b-a1d3-6b0b50d7c30d', '2aeb5dc5-120f-474c-837f-e1bfa3916a57', 'cc637523-1074-49d2-9656-455922e4b0b9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:32 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:32 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:32 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad" returned: 0 in 0.470s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Lock "cinder-quobyte-b0361f59-a9cd-4d3d-bf8c-0057b7f9c7ad" released by "delete_volume" :: held 1.111s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Created reservations ['cd59dfe0-4f11-4fc1-9576-23b0d098a81c'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:32 devstack cinder-volume[83114]: WARNING cinder.quota [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-321102374 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-321102374, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:32 devstack cinder-volume[83114]: WARNING cinder.quota [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-321102374 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-321102374, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Created reservations ['1e53717a-dcd1-467e-8c24-a8f1638d23c7', 'e58e19ac-3a26-456e-b034-3a85c6e6250e', 'fc6db23e-a948-43ee-bd53-9e38458211be', 'a69aa390-8b1f-40f8-8745-de5e74c17476'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:32 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.491s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:32 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Deleted volume successfully. Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-23e240e5-4b1f-4a2f-9216-0f5574c7e37b tempest-VolumesCloneTest-1496467207 None] Lock "cinder-2bc8ee26-f512-4a0d-a132-b8f53069f4fc-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:32 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:32 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Acquiring lock "cinder-4c931563-e205-48a7-b0fa-304b8082cf73-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Lock "cinder-4c931563-e205-48a7-b0fa-304b8082cf73-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Acquiring lock "cinder-quobyte-4c931563-e205-48a7-b0fa-304b8082cf73" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-4c931563-e205-48a7-b0fa-304b8082cf73" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1690b8c5-22ea-4a47-a0f1-ec5319b91d4e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:33 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 Feb 27 12:32:33 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Acquiring lock "cinder-346d3b41-4b93-42ea-b01b-3005f697d8d5-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Lock "cinder-346d3b41-4b93-42ea-b01b-3005f697d8d5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Acquiring lock "cinder-quobyte-346d3b41-4b93-42ea-b01b-3005f697d8d5" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Lock "cinder-quobyte-346d3b41-4b93-42ea-b01b-3005f697d8d5" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514497f-c90d-4d7e-814e-0da27e264efe]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:33 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.528s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:33 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4c29c1ca-b2a4-4a03-a656-3109cb092179 tempest-GroupsTest-686896531 None] Delete group completed successfully. Feb 27 12:32:33 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 Feb 27 12:32:33 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:33 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73" returned: 0 in 0.595s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:33 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73 Feb 27 12:32:33 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Created reservations ['f098ba45-3d1c-4852-bfd3-3ed78c4a0ccd'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:33 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5" returned: 0 in 0.614s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:34 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5 Feb 27 12:32:34 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:34 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:34 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:34 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4c931563-e205-48a7-b0fa-304b8082cf73" returned: 0 in 0.512s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Lock "cinder-quobyte-4c931563-e205-48a7-b0fa-304b8082cf73" released by "delete_volume" :: held 1.150s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Created reservations ['afcde127-43df-4351-9473-a5554537bc6e', '6b8ec57c-2321-42fb-ad1a-22539ae211bb', '79cf7631-6b29-423a-880c-1b1c5b4a347e', 'd63db55f-a9bd-4382-a9dd-e4aaed3bc2e9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:34 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:34 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:34 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-346d3b41-4b93-42ea-b01b-3005f697d8d5" returned: 0 in 0.453s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Lock "cinder-quobyte-346d3b41-4b93-42ea-b01b-3005f697d8d5" released by "delete_volume" :: held 1.096s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:34 devstack cinder-volume[83114]: WARNING cinder.quota [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1952748659 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1952748659, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:34 devstack cinder-volume[83114]: WARNING cinder.quota [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1952748659 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1952748659, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Created reservations ['4f1cdbfc-3f66-4185-9082-e4347dfd11fb', '8fb945cf-5e51-45b7-902e-4dcea9cbc386', '6ec8926b-1b40-4297-a231-4ca4f8e94146', 'bcc9ae7b-cace-4774-b9c3-7afdaff44001'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:34 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0fb3b21f-a8ba-43f6-9548-f36697b0a50a tempest-GroupsTest-686896531 None] Delete group completed successfully. Feb 27 12:32:34 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:34 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:34 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.496s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Deleted volume successfully. Feb 27 12:32:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d6a89eaa-0ae0-404a-abaa-2130e25f0d7d tempest-VolumesCloneTest-1496467207 None] Lock "cinder-4c931563-e205-48a7-b0fa-304b8082cf73-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:35 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.579s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:35 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Deleted volume successfully. Feb 27 12:32:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-acdf9619-9f64-40c0-adec-af13df0f6d5e tempest-VolumeTypesAccessTest-176275294 None] Lock "cinder-346d3b41-4b93-42ea-b01b-3005f697d8d5-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5d8547f7-5c84-4114-bbcb-39bc019a001e tempest-GroupsTest-686896531 None] Group tempest-GroupsTest-Group-739060672: creating Feb 27 12:32:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5d8547f7-5c84-4114-bbcb-39bc019a001e tempest-GroupsTest-686896531 None] Group tempest-GroupsTest-Group-739060672: created successfully Feb 27 12:32:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5d8547f7-5c84-4114-bbcb-39bc019a001e tempest-GroupsTest-686896531 None] Create group completed successfully. Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Flow 'volume_create_manager' (d69e8488-47b4-447a-8e03-d40450eb8cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5676b5e6-bea4-4502-84ad-e60e339c1e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5676b5e6-bea4-4502-84ad-e60e339c1e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1103626272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d4ef8b5-c5ce-41f2-bab6-060b32bfcc2d,host='devstack@QuobyteHD#QuobyteHD',id=970dad7e-3a4e-497a-8508-57452707d0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46f6e3ed8a84d5b9cf2aa04b12fa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:37Z,use_quota=True,user_id='d135176f9b9a4d9ba76b769cead344a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93400946-ab50-46a4-877e-36cc598f881f),volume_type_id=93400946-ab50-46a4-877e-36cc598f881f)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e42ab9-d8d4-4d7f-a0e9-5dde9d05730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e42ab9-d8d4-4d7f-a0e9-5dde9d05730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe1bbf2-9864-4a95-b01a-732373d620cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe1bbf2-9864-4a95-b01a-732373d620cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970dad7e-3a4e-497a-8508-57452707d0df', 'volume_name': 'volume-970dad7e-3a4e-497a-8508-57452707d0df', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08193f48-3c82-40c9-a242-f71d6bdbab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08193f48-3c82-40c9-a242-f71d6bdbab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4a074c-9e45-4b31-a022-c25c7ca5040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Volume 970dad7e-3a4e-497a-8508-57452707d0df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970dad7e-3a4e-497a-8508-57452707d0df', 'volume_size': 1} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d4ef8b5-c5ce-41f2-bab6-060b32bfcc2d,created_at=2026-02-27T11:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1103626272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d4ef8b5-c5ce-41f2-bab6-060b32bfcc2d,host='devstack@QuobyteHD#QuobyteHD',id=970dad7e-3a4e-497a-8508-57452707d0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46f6e3ed8a84d5b9cf2aa04b12fa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:37Z,use_quota=True,user_id='d135176f9b9a4d9ba76b769cead344a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93400946-ab50-46a4-877e-36cc598f881f),volume_type_id=93400946-ab50-46a4-877e-36cc598f881f)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Creating volume 970dad7e-3a4e-497a-8508-57452707d0df {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:37 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:37 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df 1073741824 Feb 27 12:32:37 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Flow 'volume_create_manager' (2831f4f6-69e3-4f00-beed-7486bad7bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd41c21-b708-4f94-8a43-7d693a419c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd41c21-b708-4f94-8a43-7d693a419c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644ad2ba-0274-41fc-bffb-9210a761fada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf06ef89d3304258b4e5c769a5bc2da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:38Z,use_quota=True,user_id='914119d6578e482db0eaa0e2a1ea0860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c347115b-b292-4faf-b33b-07d068ba4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c347115b-b292-4faf-b33b-07d068ba4155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86769866-e09a-4cfe-be1c-cacf58b2a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:37 devstack cinder-volume[83114]: DEBUG cinder.image.glance [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Creating Keystone auth plugin from conf {{(pid=83114) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:32:38 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df 1073741824" returned: 0 in 1.060s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:38 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df Feb 27 12:32:38 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86769866-e09a-4cfe-be1c-cacf58b2a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '644ad2ba-0274-41fc-bffb-9210a761fada', 'volume_name': 'volume-644ad2ba-0274-41fc-bffb-9210a761fada', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620c6e7a-196a-481d-a4cd-b6bfcd952c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620c6e7a-196a-481d-a4cd-b6bfcd952c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8db940-4fa5-458b-9cae-c61a94ee290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:38 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Volume 644ad2ba-0274-41fc-bffb-9210a761fada: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-644ad2ba-0274-41fc-bffb-9210a761fada', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Trying to clone 644ad2ba-0274-41fc-bffb-9210a761fada from image 449413c1-523c-4e99-abe8-e0bfc981c2bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]). {{(pid=83114) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Flow 'volume_create_manager' (e8058a35-bffb-4ac4-9490-6e2fd9afd411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346dad17-f368-4c1f-bced-7d294adeaa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346dad17-f368-4c1f-bced-7d294adeaa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1932540603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a858768b-8f30-4126-87b9-53db9c4e5e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e680da0b6a9d4b14aff60b49d1ea1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:39Z,use_quota=True,user_id='d2438e8fbc67490e885701324e986e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bb3aad-43ca-47fb-95d0-3f2bb7604395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bb3aad-43ca-47fb-95d0-3f2bb7604395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9344d80-24ba-45ab-9ee9-c639ba10b485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9344d80-24ba-45ab-9ee9-c639ba10b485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a858768b-8f30-4126-87b9-53db9c4e5e22', 'volume_name': 'volume-a858768b-8f30-4126-87b9-53db9c4e5e22', 'volume_size': 2}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdaa715-7c70-4d9a-8e2f-5be5ed4bc67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdaa715-7c70-4d9a-8e2f-5be5ed4bc67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e46ffb-b6a0-4690-a838-0e8382a36d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:39 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Volume a858768b-8f30-4126-87b9-53db9c4e5e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a858768b-8f30-4126-87b9-53db9c4e5e22', 'volume_size': 2} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:39 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df" returned: 0 in 0.743s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1932540603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a858768b-8f30-4126-87b9-53db9c4e5e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e680da0b6a9d4b14aff60b49d1ea1b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:39Z,use_quota=True,user_id='d2438e8fbc67490e885701324e986e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Creating volume a858768b-8f30-4126-87b9-53db9c4e5e22 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:39 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 2147483648 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4a074c-9e45-4b31-a022-c25c7ca5040d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970dad7e-3a4e-497a-8508-57452707d0df', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:39 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 2147483648 Feb 27 12:32:39 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ba9811-42e9-4c70-8147-06a870b463b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:39 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Volume volume-970dad7e-3a4e-497a-8508-57452707d0df (970dad7e-3a4e-497a-8508-57452707d0df): created successfully Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ba9811-42e9-4c70-8147-06a870b463b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Flow 'volume_create_manager' (d69e8488-47b4-447a-8e03-d40450eb8cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:32:39 devstack cinder-volume[83114]: INFO cinder.image.image_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:32:39 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-56d17abf-46d8-4186-9c71-21c14bbaa9a1 tempest-GroupsTest-686896531 None] Created volume successfully. Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff0ebe-dbaa-43e9-9785-18ed69d3c77f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:39 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD Feb 27 12:32:39 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:40 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc is fetched for user 914119d6578e482db0eaa0e2a1ea0860. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a06373-b791-4156-8314-298b51ec7a52]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:40 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD Feb 27 12:32:40 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:40 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 2147483648" returned: 0 in 1.366s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Flow 'volume_create_manager' (b4bbbafa-95f5-4449-8171-3d1640678def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f784db-23f9-4d32-a014-8918fa6b4aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f784db-23f9-4d32-a014-8918fa6b4aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-374874323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d4ef8b5-c5ce-41f2-bab6-060b32bfcc2d,host='devstack@QuobyteHD#QuobyteHD',id=2356f8f4-24b7-4011-a9ae-89a985c426e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46f6e3ed8a84d5b9cf2aa04b12fa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:40Z,use_quota=True,user_id='d135176f9b9a4d9ba76b769cead344a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93400946-ab50-46a4-877e-36cc598f881f),volume_type_id=93400946-ab50-46a4-877e-36cc598f881f)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c819d36-2ee1-41ca-b561-117f38af9ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c819d36-2ee1-41ca-b561-117f38af9ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baff4c1e-aac2-44c7-9ef8-73b38c99fbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baff4c1e-aac2-44c7-9ef8-73b38c99fbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2356f8f4-24b7-4011-a9ae-89a985c426e9', 'volume_name': 'volume-2356f8f4-24b7-4011-a9ae-89a985c426e9', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e81bc41-ed8a-498f-8afa-57b05fb4c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e81bc41-ed8a-498f-8afa-57b05fb4c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8336b1-a18d-4fe6-8922-5aff9c63a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:40 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Volume 2356f8f4-24b7-4011-a9ae-89a985c426e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2356f8f4-24b7-4011-a9ae-89a985c426e9', 'volume_size': 1} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:40 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 Feb 27 12:32:40 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:40 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD" returned: 0 in 0.617s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:41 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22" returned: 0 in 0.612s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d4ef8b5-c5ce-41f2-bab6-060b32bfcc2d,created_at=2026-02-27T11:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-374874323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d4ef8b5-c5ce-41f2-bab6-060b32bfcc2d,host='devstack@QuobyteHD#QuobyteHD',id=2356f8f4-24b7-4011-a9ae-89a985c426e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46f6e3ed8a84d5b9cf2aa04b12fa444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:40Z,use_quota=True,user_id='d135176f9b9a4d9ba76b769cead344a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93400946-ab50-46a4-877e-36cc598f881f),volume_type_id=93400946-ab50-46a4-877e-36cc598f881f)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Creating volume 2356f8f4-24b7-4011-a9ae-89a985c426e9 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:41 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e46ffb-b6a0-4690-a838-0e8382a36d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a858768b-8f30-4126-87b9-53db9c4e5e22', 'volume_size': 2}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70d1586-1b42-4bf7-9f95-c1edd2a752ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:41 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Volume volume-a858768b-8f30-4126-87b9-53db9c4e5e22 (a858768b-8f30-4126-87b9-53db9c4e5e22): created successfully Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70d1586-1b42-4bf7-9f95-c1edd2a752ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:41 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 1073741824 Feb 27 12:32:41 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Flow 'volume_create_manager' (e8058a35-bffb-4ac4-9490-6e2fd9afd411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d82fa71c-98c0-4c32-a8f8-707dd2a140b3 tempest-VolumesCloneNegativeTest-1422364458 None] Created volume successfully. Feb 27 12:32:41 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 1073741824" returned: 0 in 0.629s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:41 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 Feb 27 12:32:41 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:42 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9" returned: 0 in 0.472s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=644ad2ba-0274-41fc-bffb-9210a761fada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf06ef89d3304258b4e5c769a5bc2da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:38Z,use_quota=True,user_id='914119d6578e482db0eaa0e2a1ea0860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Creating volume 644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:42 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8336b1-a18d-4fe6-8922-5aff9c63a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2356f8f4-24b7-4011-a9ae-89a985c426e9', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb990f4-2dfa-4463-a13b-8f94bf03fb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:42 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Volume volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 (2356f8f4-24b7-4011-a9ae-89a985c426e9): created successfully Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb990f4-2dfa-4463-a13b-8f94bf03fb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Flow 'volume_create_manager' (b4bbbafa-95f5-4449-8171-3d1640678def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:42 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada 1073741824 Feb 27 12:32:42 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4e0aa98a-2794-4c52-ae6d-37efeb2e7e58 tempest-GroupsTest-686896531 None] Created volume successfully. Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Acquiring lock "cinder-a858768b-8f30-4126-87b9-53db9c4e5e22-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "cinder-a858768b-8f30-4126-87b9-53db9c4e5e22-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Acquiring lock "cinder-quobyte-a858768b-8f30-4126-87b9-53db9c4e5e22" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "cinder-quobyte-a858768b-8f30-4126-87b9-53db9c4e5e22" acquired by "delete_volume" :: waited 0.023s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-bb4c2415-e647-42be-8fa4-a46148475ccc tempest-GroupsTest-686896531 None] Update group completed successfully. Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e705c2d-cf01-4678-9f97-56787edf6972]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:42 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 Feb 27 12:32:42 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:43 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada 1073741824" returned: 0 in 0.827s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:43 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:32:43 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:43 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22" returned: 0 in 0.658s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:43 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22 Feb 27 12:32:43 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:43 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 0 in 0.695s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:43 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Attempting download of 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume 644ad2ba-0274-41fc-bffb-9210a761fada. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[861a6bb3-74d7-41b5-9b19-15953d0de7c3]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_5dxbps1k {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:44 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c6ff99e2-cfcf-460c-bbea-a7b71d2e9532 tempest-GroupsTest-686896531 None] Update group completed successfully. Feb 27 12:32:44 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a858768b-8f30-4126-87b9-53db9c4e5e22" returned: 0 in 0.756s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "cinder-quobyte-a858768b-8f30-4126-87b9-53db9c4e5e22" released by "delete_volume" :: held 1.470s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:44 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_5dxbps1k Feb 27 12:32:44 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Created reservations ['18eb66fe-c127-4056-b286-4d6d9f424c6f', '2f79fe4b-e8fc-487a-88f0-174181a00703', '7c0be96e-92d0-4290-b54a-67fb5425e699', 'fa37d3ec-c741-4cd2-95f1-29402c1de1ba'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:44 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:44 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:44 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_5dxbps1k" returned: 0 in 0.684s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_5dxbps1k {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:44 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.564s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:44 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Deleted volume successfully. Feb 27 12:32:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9172fbff-dd93-40d9-bbe9-705bf7f3f3b7 tempest-VolumesCloneNegativeTest-1422364458 None] Lock "cinder-a858768b-8f30-4126-87b9-53db9c4e5e22-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:44 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_5dxbps1k Feb 27 12:32:44 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:45 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_5dxbps1k" returned: 1 in 0.691s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_5dxbps1k' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f679f93-f586-44dd-9912-0699682979e1]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:45 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD Feb 27 12:32:45 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Acquiring lock "cinder-quobyte-2356f8f4-24b7-4011-a9ae-89a985c426e9" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Lock "cinder-quobyte-2356f8f4-24b7-4011-a9ae-89a985c426e9" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7f517-aa2e-49bb-9e40-7ff7da19b45a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:45 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 Feb 27 12:32:45 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:46 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:46 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] 449413c1-523c-4e99-abe8-e0bfc981c2bc was qcow2, converting to raw {{(pid=83114) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:32:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:46 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:32:46 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:46 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9" returned: 0 in 0.790s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:46 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9 Feb 27 12:32:46 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:47 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2356f8f4-24b7-4011-a9ae-89a985c426e9" returned: 0 in 1.057s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:47 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Lock "cinder-quobyte-2356f8f4-24b7-4011-a9ae-89a985c426e9" released by "delete_volume" :: held 1.873s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Acquiring lock "cinder-quobyte-970dad7e-3a4e-497a-8508-57452707d0df" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 0 in 1.437s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_hgmduofidevstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:32:47 devstack cinder-volume[83114]: INFO cinder.image.image_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Converted 112.00 MB image at 77.92 MB/s Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Lock "cinder-quobyte-970dad7e-3a4e-497a-8508-57452707d0df" acquired by "delete_volume" :: waited 0.024s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:47 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada 1G Feb 27 12:32:47 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac252f0-d785-42f4-8408-d7b205740491]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:47 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df Feb 27 12:32:47 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:48 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df" returned: 0 in 0.694s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:48 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df Feb 27 12:32:48 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Flow 'volume_create_manager' (51a20906-9a96-4450-9472-8318728d5ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90444eb2-2bdf-4ec5-b171-650e59a2e122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90444eb2-2bdf-4ec5-b171-650e59a2e122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1413025764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ff1b70-f2a9-4384-9bab-19dac887ac24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f56535af2cc4aa6b922bf54ac505bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:48Z,use_quota=True,user_id='396fec14292e445cadf45e5d73567722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645a84ec-79d9-49fe-b8b1-f67e82470fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:48 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645a84ec-79d9-49fe-b8b1-f67e82470fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16eb74d-1dc3-4d88-8c0d-31df2ef3e985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16eb74d-1dc3-4d88-8c0d-31df2ef3e985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ff1b70-f2a9-4384-9bab-19dac887ac24', 'volume_name': 'volume-42ff1b70-f2a9-4384-9bab-19dac887ac24', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5262f6d-a0b4-4d7a-8244-ec025b7f3a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5262f6d-a0b4-4d7a-8244-ec025b7f3a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ef3803-d8c4-4fdb-a246-19c46b49d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:48 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Volume 42ff1b70-f2a9-4384-9bab-19dac887ac24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ff1b70-f2a9-4384-9bab-19dac887ac24', 'volume_size': 1} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1413025764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ff1b70-f2a9-4384-9bab-19dac887ac24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f56535af2cc4aa6b922bf54ac505bcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:48Z,use_quota=True,user_id='396fec14292e445cadf45e5d73567722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Creating volume 42ff1b70-f2a9-4384-9bab-19dac887ac24 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:48 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada 1G" returned: 0 in 1.023s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:48 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 1073741824 Feb 27 12:32:48 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e83e46-fe9c-49c0-a2e4-66cc3c28857f]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:48 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:32:48 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:48 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-970dad7e-3a4e-497a-8508-57452707d0df" returned: 0 in 0.594s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Lock "cinder-quobyte-970dad7e-3a4e-497a-8508-57452707d0df" released by "delete_volume" :: held 1.329s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:32:48 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Created reservations ['e3cb9e38-571a-48ad-a815-34a78266d5c6'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:49 devstack cinder-volume[83114]: WARNING cinder.quota [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1993584946 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1993584946, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:49 devstack cinder-volume[83114]: WARNING cinder.quota [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1993584946 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1993584946, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Created reservations ['250aa46e-43fe-4618-a84d-00906b1788e1', '168314a6-7ce5-47c0-a1bc-36e4bfbcf71d', 'deff87b9-254e-45ae-b307-0b330b84c7bb', '28846e8d-08c5-4160-947b-e9ded4e7d6f0'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Created reservations ['bdeb6f36-38cc-4a34-b39e-e931d992bd15', '022f48e8-4e0f-484a-a569-905ef719c9bf', '8f2a2bd9-22bb-4e8a-b54d-9d63d3ce2f25', 'd5bc1076-adea-4491-8546-3661620fe2b1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:49 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:32:49 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:49 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 0 in 0.890s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:49 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 1073741824" returned: 0 in 0.963s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:49 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 Feb 27 12:32:49 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:49 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:32:49 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:49 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.652s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:49 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:32:49 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ee7c5e0a-b9fc-4a5d-945d-1e45ee86ef35 tempest-GroupsTest-686896531 None] Delete group completed successfully. Feb 27 12:32:50 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24" returned: 0 in 0.673s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:UPDATE=196,cinder:SELECT=166,cinder:INSERT=43,cinder:DELETE=11 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ef3803-d8c4-4fdb-a246-19c46b49d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ff1b70-f2a9-4384-9bab-19dac887ac24', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b166bc-ccb8-46fb-9df0-c46ae0d6095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=148,cinder:INSERT=49,cinder:UPDATE=181,cinder:DELETE=10 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:32:50 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Volume volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 (42ff1b70-f2a9-4384-9bab-19dac887ac24): created successfully Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b166bc-ccb8-46fb-9df0-c46ae0d6095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Flow 'volume_create_manager' (51a20906-9a96-4450-9472-8318728d5ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:50 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 1 in 0.788s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:32:50 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ed887abc-697a-4e3c-9ba7-3614821b3c0c tempest-VolumesNegativeTest-350143835 None] Created volume successfully. Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Downloaded image 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume 644ad2ba-0274-41fc-bffb-9210a761fada successfully. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc for user 914119d6578e482db0eaa0e2a1ea0860 is deleted. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Marking volume 644ad2ba-0274-41fc-bffb-9210a761fada as bootable. {{(pid=83114) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Copying metadata from image 449413c1-523c-4e99-abe8-e0bfc981c2bc to 644ad2ba-0274-41fc-bffb-9210a761fada. {{(pid=83114) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Creating volume glance metadata for volume 644ad2ba-0274-41fc-bffb-9210a761fada backed by image 449413c1-523c-4e99-abe8-e0bfc981c2bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83114) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8db940-4fa5-458b-9cae-c61a94ee290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-644ad2ba-0274-41fc-bffb-9210a761fada', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061332fb-8cd0-414d-8156-d2b7f5837d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:50 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Volume volume-644ad2ba-0274-41fc-bffb-9210a761fada (644ad2ba-0274-41fc-bffb-9210a761fada): created successfully Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061332fb-8cd0-414d-8156-d2b7f5837d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Flow 'volume_create_manager' (2831f4f6-69e3-4f00-beed-7486bad7bb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Flow 'volume_create_manager' (b5349463-31ff-4687-9e31-c0f24b7c28d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb065d04-507a-4b35-8174-863379ba4ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:50 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-859cf0fd-735a-4f03-8d0a-188e1714525f tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Created volume successfully. Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb065d04-507a-4b35-8174-863379ba4ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-497510895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d9c981-0989-4429-989b-e99e848ff9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013986ac821541e382985c15f35f518c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:50Z,use_quota=True,user_id='9778e835338642d393998366cb51d871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35bcc0d-096d-4491-bf5b-fc4d58042b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35bcc0d-096d-4491-bf5b-fc4d58042b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092e6206-c009-4a94-9b45-e7d81067dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.image.glance [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Creating Keystone auth plugin from conf {{(pid=83114) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092e6206-c009-4a94-9b45-e7d81067dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5d9c981-0989-4429-989b-e99e848ff9c7', 'volume_name': 'volume-e5d9c981-0989-4429-989b-e99e848ff9c7', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327abce8-ebec-47cc-9157-d842d116b1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327abce8-ebec-47cc-9157-d842d116b1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab0148-c9f2-4759-b744-eae7d716a1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:50 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Volume e5d9c981-0989-4429-989b-e99e848ff9c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5d9c981-0989-4429-989b-e99e848ff9c7', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:32:50 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Trying to clone e5d9c981-0989-4429-989b-e99e848ff9c7 from image 449413c1-523c-4e99-abe8-e0bfc981c2bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]). {{(pid=83114) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:32:51 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:32:51 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:32:51 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ceca52-8c4b-4000-8ee6-f01d664bcab7]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:51 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD Feb 27 12:32:51 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:51 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:51 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc is fetched for user 9778e835338642d393998366cb51d871. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:32:51 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fddf4fc-d23f-4590-8cfb-e60943997705]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:51 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD Feb 27 12:32:51 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:52 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD" returned: 0 in 0.609s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-497510895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d9c981-0989-4429-989b-e99e848ff9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013986ac821541e382985c15f35f518c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:32:50Z,use_quota=True,user_id='9778e835338642d393998366cb51d871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Creating volume e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:32:52 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:32:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:52 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 1073741824 Feb 27 12:32:52 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:53 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 1073741824" returned: 0 in 0.601s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:53 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 Feb 27 12:32:53 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:32:53 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7" returned: 0 in 0.572s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.136s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Attempting download of 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume e5d9c981-0989-4429-989b-e99e848ff9c7. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bdef17-bdf2-4c4c-86a6-f7a1ea103f88]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfddc43-e6c8-4341-8321-76fa6192565e]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ylei0g2g {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:53 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:32:53 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:53 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ylei0g2g Feb 27 12:32:53 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:54 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 0 in 0.498s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:54 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:54 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:32:54 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ylei0g2g" returned: 0 in 0.560s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ylei0g2g {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:54 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ylei0g2g Feb 27 12:32:54 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:54 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 1 in 0.559s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.089s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769', 'name': 'volume-644ad2ba-0274-41fc-bffb-9210a761fada', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e01d3bb9-a1c9-4435-aa6d-017b557d62af', 'enforce_multipath': True} {{(pid=83114) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 12:32:54 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ylei0g2g" returned: 1 in 0.532s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ylei0g2g' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd7ea6-55ec-4d03-b70c-1b0538f2176d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:54 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-4014f299-43bf-467e-bb7c-a40f5eb30f16 req-878bbaec-d876-46bb-a60e-19fca31bb22c tempest-ServerBootFromVolumeStableRescueTest-978880326 None] attachment_update completed successfully. Feb 27 12:32:54 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD Feb 27 12:32:54 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:55 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD" returned: 0 in 0.563s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:55 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] 449413c1-523c-4e99-abe8-e0bfc981c2bc was qcow2, converting to raw {{(pid=83114) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:32:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:55 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 Feb 27 12:32:55 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:56 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7" returned: 0 in 1.234s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:56 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_xq5_piq9devstack@QuobyteHD, size 112.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:32:56 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Converted 112.00 MB image at 90.66 MB/s Feb 27 12:32:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:56 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 1G Feb 27 12:32:56 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:57 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 1G" returned: 0 in 0.613s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:57 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb414e5-38ed-485f-bec1-7949b4a98e1f]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:57 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 Feb 27 12:32:57 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:57 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7" returned: 0 in 0.502s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:57 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 Feb 27 12:32:57 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:32:58 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7" returned: 1 in 0.480s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Downloaded image 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume e5d9c981-0989-4429-989b-e99e848ff9c7 successfully. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc for user 9778e835338642d393998366cb51d871 is deleted. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Marking volume e5d9c981-0989-4429-989b-e99e848ff9c7 as bootable. {{(pid=83114) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Copying metadata from image 449413c1-523c-4e99-abe8-e0bfc981c2bc to e5d9c981-0989-4429-989b-e99e848ff9c7. {{(pid=83114) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Creating volume glance metadata for volume e5d9c981-0989-4429-989b-e99e848ff9c7 backed by image 449413c1-523c-4e99-abe8-e0bfc981c2bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83114) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab0148-c9f2-4759-b744-eae7d716a1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d9c981-0989-4429-989b-e99e848ff9c7', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469bfe52-d1d0-410e-9f21-b4341991355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:32:58 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Volume volume-e5d9c981-0989-4429-989b-e99e848ff9c7 (e5d9c981-0989-4429-989b-e99e848ff9c7): created successfully Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469bfe52-d1d0-410e-9f21-b4341991355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:32:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Flow 'volume_create_manager' (b5349463-31ff-4687-9e31-c0f24b7c28d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:32:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-43f10a1f-83ea-413a-b560-5c2bbb76afc3 tempest-VolumesImageMetadata-1741822511 None] Created volume successfully. Feb 27 12:32:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Acquiring lock "cinder-e5d9c981-0989-4429-989b-e99e848ff9c7-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Lock "cinder-e5d9c981-0989-4429-989b-e99e848ff9c7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Acquiring lock "cinder-quobyte-e5d9c981-0989-4429-989b-e99e848ff9c7" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:32:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Lock "cinder-quobyte-e5d9c981-0989-4429-989b-e99e848ff9c7" acquired by "delete_volume" :: waited 0.045s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:32:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[22706cd0-272a-48a8-947b-b17b9a79c586]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:32:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:32:59 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 Feb 27 12:32:59 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:01 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7" returned: 0 in 1.408s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:01 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 Feb 27 12:33:01 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:02 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7" returned: 1 in 1.134s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:02 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7 Feb 27 12:33:02 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:03 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5d9c981-0989-4429-989b-e99e848ff9c7" returned: 0 in 1.091s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Lock "cinder-quobyte-e5d9c981-0989-4429-989b-e99e848ff9c7" released by "delete_volume" :: held 3.748s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Created reservations ['4dd0c84b-0bc0-4dc5-86a7-a89708b95b75', 'bca377cc-b5cb-431b-89ad-833a95166f0a', '80f04db8-0b4b-4a50-aaa5-b4ed804fbf65', '2bf971c3-a9dd-4533-9394-84e2983e1be1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:03 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:03 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:05 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 1.620s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:05 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:05 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Deleted volume successfully. Feb 27 12:33:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-781a2dd1-2d9d-402a-975c-3b80ff4dcd2a tempest-VolumesImageMetadata-1741822511 None] Lock "cinder-e5d9c981-0989-4429-989b-e99e848ff9c7-delete_volume" released by "delete_volume" :: held 5.790s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Flow 'volume_create_manager' (3dbcaa1e-61f7-40a6-bda6-f1c3ab2abd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d07576f-cc03-4729-88ab-7a4f18642a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d07576f-cc03-4729-88ab-7a4f18642a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1830513683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef5b33e-63ae-49d1-b63a-7b1cf7d21474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c412df66db49a69f461ea6f791df10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:07Z,use_quota=True,user_id='14647780c3e9414895d339fcc2f2abbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79ec8c9-cac9-4a3d-bfd9-56b72d0221de),volume_type_id=f79ec8c9-cac9-4a3d-bfd9-56b72d0221de)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a7cdb7-d306-4364-8a5e-2b1b465a6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a7cdb7-d306-4364-8a5e-2b1b465a6d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b1c80c-7438-498b-9930-1d5fdfa5cd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b1c80c-7438-498b-9930-1d5fdfa5cd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef5b33e-63ae-49d1-b63a-7b1cf7d21474', 'volume_name': 'volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ac397b-5043-4922-bfa5-81acdd292cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ac397b-5043-4922-bfa5-81acdd292cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603c551-fb53-4b39-83a0-d3259f8a3325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:06 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Volume eef5b33e-63ae-49d1-b63a-7b1cf7d21474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474', 'volume_size': 1} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1830513683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef5b33e-63ae-49d1-b63a-7b1cf7d21474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c412df66db49a69f461ea6f791df10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:07Z,use_quota=True,user_id='14647780c3e9414895d339fcc2f2abbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f79ec8c9-cac9-4a3d-bfd9-56b72d0221de),volume_type_id=f79ec8c9-cac9-4a3d-bfd9-56b72d0221de)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Creating volume eef5b33e-63ae-49d1-b63a-7b1cf7d21474 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:06 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:07 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 1073741824 Feb 27 12:33:07 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:07 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:07 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:07 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 1073741824" returned: 0 in 0.677s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:07 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 Feb 27 12:33:07 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:07 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.601s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:07 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:08 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474" returned: 0 in 0.560s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603c551-fb53-4b39-83a0-d3259f8a3325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d115a476-501f-43b9-8c1e-6a768b2afca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:08 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Volume volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 (eef5b33e-63ae-49d1-b63a-7b1cf7d21474): created successfully Feb 27 12:33:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d115a476-501f-43b9-8c1e-6a768b2afca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Flow 'volume_create_manager' (3dbcaa1e-61f7-40a6-bda6-f1c3ab2abd0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2280a930-aa46-4f10-99b4-ce98f475fec5 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Created volume successfully. Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Flow 'volume_create_manager' (446154e9-8539-4b65-910e-671354052ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e483cd-5200-4e2d-baf6-0b4874ee870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e483cd-5200-4e2d-baf6-0b4874ee870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-323244888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63fd0fe9b8c4d3eaee1eb61e5e4a2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:09Z,use_quota=True,user_id='72bce1e5d158451caa5dad4569c94ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c051161d-d3ba-4806-a781-323a563713ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c051161d-d3ba-4806-a781-323a563713ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc36082b-5b8f-45ef-9857-9518cbe2e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc36082b-5b8f-45ef-9857-9518cbe2e86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8', 'volume_name': 'volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53eb29fb-3c4b-48e2-a591-20d8ee046a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53eb29fb-3c4b-48e2-a591-20d8ee046a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82453178-2968-469d-9ed1-0287f1a938ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:09 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Volume f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8', 'volume_size': 1} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-323244888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63fd0fe9b8c4d3eaee1eb61e5e4a2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:09Z,use_quota=True,user_id='72bce1e5d158451caa5dad4569c94ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Creating volume f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:09 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 1073741824 Feb 27 12:33:09 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack sudo[86951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:09 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:09 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 1073741824" returned: 0 in 0.573s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:09 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.495s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:09 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:09 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 Feb 27 12:33:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-226f5e7d-6ad9-4e2b-9e3e-e864ec28f411 tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Retype volume completed successfully. Feb 27 12:33:09 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:10 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8" returned: 0 in 0.510s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82453178-2968-469d-9ed1-0287f1a938ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de21d6f-29ff-44b0-b15c-b4ddbca08c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:10 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Volume volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 (f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8): created successfully Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de21d6f-29ff-44b0-b15c-b4ddbca08c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Flow 'volume_create_manager' (446154e9-8539-4b65-910e-671354052ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Acquiring lock "cinder-eef5b33e-63ae-49d1-b63a-7b1cf7d21474-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-a63d984c-13a0-4bbe-baac-100a45824c88 tempest-AbsoluteLimitsTests-751368618 None] Created volume successfully. Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "cinder-eef5b33e-63ae-49d1-b63a-7b1cf7d21474-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Acquiring lock "cinder-quobyte-eef5b33e-63ae-49d1-b63a-7b1cf7d21474" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "cinder-quobyte-eef5b33e-63ae-49d1-b63a-7b1cf7d21474" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5db70a3-1346-4c41-8871-f33b561ae7b4]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:10 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 Feb 27 12:33:10 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474" returned: 0 in 0.570s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:11 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474 Feb 27 12:33:11 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Acquiring lock "cinder-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Lock "cinder-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Acquiring lock "cinder-quobyte-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Lock "cinder-quobyte-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5980b60-3aae-49a9-be19-136fe8ff81b5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:11 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 Feb 27 12:33:11 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:11 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-eef5b33e-63ae-49d1-b63a-7b1cf7d21474" returned: 0 in 0.533s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "cinder-quobyte-eef5b33e-63ae-49d1-b63a-7b1cf7d21474" released by "delete_volume" :: held 1.141s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:11 devstack cinder-volume[83114]: WARNING cinder.quota [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:33:11 devstack cinder-volume[83114]: WARNING cinder.quota [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Created reservations ['f641114f-6e75-4dea-81e1-38e52081d89c', '0fd7ad63-a94d-4b94-a6e5-3ca76f557557', '54b50ea2-7f3b-4cb4-b88d-ea736531c9a6', '3fc70926-c364-4e41-9c25-eb54bc4556e7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:11 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:11 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:12 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8" returned: 0 in 0.615s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:12 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8 Feb 27 12:33:12 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:12 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.514s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Deleted volume successfully. Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2994cbed-289a-4e5d-a2d5-57359201572e tempest-VolumeRetypeWithoutMigrationTest-1931655379 None] Lock "cinder-eef5b33e-63ae-49d1-b63a-7b1cf7d21474-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:12 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8" returned: 0 in 0.541s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Lock "cinder-quobyte-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8" released by "delete_volume" :: held 1.180s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Created reservations ['f4b284ee-fda4-4aff-a223-35cf827fd384', 'f17e8fc1-33fb-448d-8e4c-51f4dba83763', 'd5e8cd14-d3f8-4b0e-96b7-652daff95928', '0774b9eb-2dec-4e5b-8597-01dc8d61cae3'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:12 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:12 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:13 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.564s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:13 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:13 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Deleted volume successfully. Feb 27 12:33:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c54a281e-95c4-446e-ba61-9a02ca1e6fb8 tempest-AbsoluteLimitsTests-751368618 None] Lock "cinder-f1ddcef7-f8f3-42bf-a6c2-434a7fd99ac8-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Flow 'volume_create_manager' (3ae9d14e-0936-474a-94a4-ba5a9e812065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3399b224-7781-4cb1-9e87-bb5bd497b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3399b224-7781-4cb1-9e87-bb5bd497b196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1753957570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f00af7-53ed-47c9-a79c-ddc3c966baaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc5174c509549e98bf74fec79ff304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:19Z,use_quota=True,user_id='24887e0d3b294b3fa54de6e937a5a25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05e4ec0-5c7c-456e-9c9a-7846c54bdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05e4ec0-5c7c-456e-9c9a-7846c54bdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6410637a-84d3-4962-b6c5-07c3e67de1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6410637a-84d3-4962-b6c5-07c3e67de1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f00af7-53ed-47c9-a79c-ddc3c966baaa', 'volume_name': 'volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b2d1f2-86f2-45b4-85ce-bff458732da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b2d1f2-86f2-45b4-85ce-bff458732da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80d9027-231d-4752-a44c-38a7aa3ee3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Volume a8f00af7-53ed-47c9-a79c-ddc3c966baaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa', 'volume_size': 1} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1753957570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f00af7-53ed-47c9-a79c-ddc3c966baaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc5174c509549e98bf74fec79ff304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:19Z,use_quota=True,user_id='24887e0d3b294b3fa54de6e937a5a25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Creating volume a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:19 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:19 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa 1073741824 Feb 27 12:33:19 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Flow 'volume_create_manager' (7cf3bdf1-039f-466c-ad1f-88283470a7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c114e97-e05c-4a57-b613-8e02964bf823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c114e97-e05c-4a57-b613-8e02964bf823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-574152272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08601686-180a-4a56-ac60-aecdc6ad289b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b670aebf160460da4411cc089e70a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:20Z,use_quota=True,user_id='918e899001ef4e82af0d5624a176ca2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a86b43-b88c-4492-a763-8d59584a1c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a86b43-b88c-4492-a763-8d59584a1c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da249c3e-b6a4-4a12-bed3-981f8a96fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da249c3e-b6a4-4a12-bed3-981f8a96fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08601686-180a-4a56-ac60-aecdc6ad289b', 'volume_name': 'volume-08601686-180a-4a56-ac60-aecdc6ad289b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1257e4ad-7d7e-4394-aa28-0544de02b679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1257e4ad-7d7e-4394-aa28-0544de02b679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65076fc1-0046-4371-813b-5c485c04787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Volume 08601686-180a-4a56-ac60-aecdc6ad289b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08601686-180a-4a56-ac60-aecdc6ad289b', 'volume_size': 1} Feb 27 12:33:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:20 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa 1073741824" returned: 0 in 0.872s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:20 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa Feb 27 12:33:20 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:21 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" returned: 0 in 0.869s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-574152272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08601686-180a-4a56-ac60-aecdc6ad289b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b670aebf160460da4411cc089e70a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:20Z,use_quota=True,user_id='918e899001ef4e82af0d5624a176ca2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Creating volume 08601686-180a-4a56-ac60-aecdc6ad289b {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:21 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:21 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b 1073741824 Feb 27 12:33:21 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Acquiring lock "cinder-42ff1b70-f2a9-4384-9bab-19dac887ac24-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80d9027-231d-4752-a44c-38a7aa3ee3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf84009-8fd3-4b5c-ae78-dd7260b6d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Lock "cinder-42ff1b70-f2a9-4384-9bab-19dac887ac24-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Volume volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa (a8f00af7-53ed-47c9-a79c-ddc3c966baaa): created successfully Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf84009-8fd3-4b5c-ae78-dd7260b6d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Flow 'volume_create_manager' (3ae9d14e-0936-474a-94a4-ba5a9e812065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-79fd51cd-d652-4d63-b678-3b1d9f4c5380 tempest-VolumesDeleteCascade-2020851104 None] Created volume successfully. Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Acquiring lock "cinder-quobyte-42ff1b70-f2a9-4384-9bab-19dac887ac24" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Lock "cinder-quobyte-42ff1b70-f2a9-4384-9bab-19dac887ac24" acquired by "delete_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc25fd72-0bf3-4f92-ad03-b82739eee15a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:21 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 Feb 27 12:33:21 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:21 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b 1073741824" returned: 0 in 0.728s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:21 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b Feb 27 12:33:21 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:22 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24" returned: 0 in 0.706s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:22 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24 Feb 27 12:33:22 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:22 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b" returned: 0 in 0.595s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65076fc1-0046-4371-813b-5c485c04787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08601686-180a-4a56-ac60-aecdc6ad289b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fc845f-c33a-4918-a1ca-05ed5ab0d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:22 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Volume volume-08601686-180a-4a56-ac60-aecdc6ad289b (08601686-180a-4a56-ac60-aecdc6ad289b): created successfully Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fc845f-c33a-4918-a1ca-05ed5ab0d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Flow 'volume_create_manager' (7cf3bdf1-039f-466c-ad1f-88283470a7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:22 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0f19f9ec-959d-4da0-b093-bb9998851fe7 tempest-VolumesServicesTestJSON-336518543 None] Created volume successfully. Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Creating offline snapshot 7fcce365-b432-47c8-b75f-0a333aac6125 of volume a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf6ca06-8c44-421d-b00a-db352d0b7a56]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:22 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-42ff1b70-f2a9-4384-9bab-19dac887ac24" returned: 0 in 0.777s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Lock "cinder-quobyte-42ff1b70-f2a9-4384-9bab-19dac887ac24" released by "delete_volume" :: held 1.554s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:22 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa Feb 27 12:33:22 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:22 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Created reservations ['dbf836bf-ca5f-4a81-8ecd-92e964f852e5', '3a122e62-fd2f-4f9a-b183-753e71bf4537', 'b803ca09-4b27-45e1-959f-e2f3e3e193e9', '8e4aadc7-e048-46fc-85bc-8e42b3cd9013'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Acquiring lock "cinder-08601686-180a-4a56-ac60-aecdc6ad289b-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Lock "cinder-08601686-180a-4a56-ac60-aecdc6ad289b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:23 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:23 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Acquiring lock "cinder-quobyte-08601686-180a-4a56-ac60-aecdc6ad289b" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Lock "cinder-quobyte-08601686-180a-4a56-ac60-aecdc6ad289b" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaaa361-9e32-49a7-900f-b574d59543be]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:23 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b Feb 27 12:33:23 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:23 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" returned: 0 in 1.032s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:23 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.661s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:23 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 1G Feb 27 12:33:23 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:23 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Deleted volume successfully. Feb 27 12:33:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6b23bde1-ee53-4c29-8dd9-a3a6a274daef tempest-VolumesNegativeTest-350143835 None] Lock "cinder-42ff1b70-f2a9-4384-9bab-19dac887ac24-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:24 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b" returned: 0 in 0.729s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:24 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b Feb 27 12:33:24 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:24 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 1G" returned: 0 in 0.800s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:24 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-08601686-180a-4a56-ac60-aecdc6ad289b" returned: 0 in 0.590s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Lock "cinder-quobyte-08601686-180a-4a56-ac60-aecdc6ad289b" released by "delete_volume" :: held 1.373s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:24 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 Feb 27 12:33:24 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Created reservations ['081d3dc1-fd04-4552-a3ef-a3a3715e8944', '4ff2bbf8-ee76-4e3f-834b-bb5ee3103f44', '3463593d-c185-4086-81a5-53c8f6896057', '73bba552-9592-41d8-9f98-a6b2b2ac18af'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:24 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:24 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:25 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125" returned: 0 in 0.660s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:25 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 is being set with open permissions: ugo+rw Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:25 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.487s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:25 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 Feb 27 12:33:25 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:25 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Deleted volume successfully. Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-db14a9bf-e5ab-4b33-af04-4092fe5f8d17 tempest-VolumesServicesTestJSON-336518543 None] Lock "cinder-08601686-180a-4a56-ac60-aecdc6ad289b-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:25 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Flow 'volume_create_manager' (c1a07ecf-0066-4f1a-8ab1-ede8f69b579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d27c4de-57ce-4016-8c6e-e3f8017277d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125" returned: 0 in 0.561s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d27c4de-57ce-4016-8c6e-e3f8017277d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-850945428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce62f905-1d7d-4002-8ad4-8394261ceb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa7480958b3431f926da47aa8d0aefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:26Z,use_quota=True,user_id='655ab0569c6d42ad83ac044bdd67f9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee2ef76-d261-4ef4-820d-a0d871fd10b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee2ef76-d261-4ef4-820d-a0d871fd10b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59281e9c-f91c-4789-9887-5e3f8bd8c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59281e9c-f91c-4789-9887-5e3f8bd8c61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce62f905-1d7d-4002-8ad4-8394261ceb3f', 'volume_name': 'volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06408eb0-d49f-47cc-be83-7ff51b8e5e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06408eb0-d49f-47cc-be83-7ff51b8e5e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9049ca-137b-4d6e-bad4-89dfcbf6d62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:25 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Volume ce62f905-1d7d-4002-8ad4-8394261ceb3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f', 'volume_size': 1} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:25 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.info Feb 27 12:33:25 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:26 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.info" returned: 0 in 0.497s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:26 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.info is being set with open permissions: ugo+rw Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:26 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.info Feb 27 12:33:26 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:26 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.info" returned: 0 in 0.504s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-850945428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce62f905-1d7d-4002-8ad4-8394261ceb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efa7480958b3431f926da47aa8d0aefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:26Z,use_quota=True,user_id='655ab0569c6d42ad83ac044bdd67f9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Creating volume ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:26 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:26 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f 1073741824 Feb 27 12:33:26 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:26 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b47c71b8-41be-49e2-8748-594750be0919 tempest-VolumesDeleteCascade-2020851104 None] Create snapshot completed successfully Feb 27 12:33:27 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-14b75a3f-bd20-40e2-9f33-b5f33838e2c4 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Terminate volume connection completed successfully. Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-14b75a3f-bd20-40e2-9f33-b5f33838e2c4 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Deleting attachment e01d3bb9-a1c9-4435-aa6d-017b557d62af. {{(pid=83114) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 12:33:27 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f 1073741824" returned: 0 in 0.587s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:27 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f Feb 27 12:33:27 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "cinder-644ad2ba-0274-41fc-bffb-9210a761fada-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-644ad2ba-0274-41fc-bffb-9210a761fada-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "cinder-quobyte-644ad2ba-0274-41fc-bffb-9210a761fada" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-quobyte-644ad2ba-0274-41fc-bffb-9210a761fada" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[af63a178-7f0c-4e4f-ae39-68f99db79b1f]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:27 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:33:27 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:28 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f" returned: 0 in 0.604s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.058s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9049ca-137b-4d6e-bad4-89dfcbf6d62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427ede26-197b-41ba-9ba4-d2d6a297a3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Creating offline snapshot 1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 of volume a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:28 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Volume volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f (ce62f905-1d7d-4002-8ad4-8394261ceb3f): created successfully Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (427ede26-197b-41ba-9ba4-d2d6a297a3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Flow 'volume_create_manager' (c1a07ecf-0066-4f1a-8ab1-ede8f69b579b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b33c55-fa97-4473-9cef-35a44abb564d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:28 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e194c31b-3857-45d1-a44a-de249b52a8dd tempest-VolumesSnapshotListTestJSON-222570537 None] Created volume successfully. Feb 27 12:33:28 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 Feb 27 12:33:28 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:28 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 0 in 0.723s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:28 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:33:28 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:28 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125" returned: 0 in 0.584s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:28 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 1G Feb 27 12:33:28 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:29 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 1 in 0.566s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:29 devstack sudo[87190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada Feb 27 12:33:29 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:29 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 1G" returned: 0 in 0.599s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:29 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 Feb 27 12:33:29 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:29 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-644ad2ba-0274-41fc-bffb-9210a761fada" returned: 0 in 0.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-quobyte-644ad2ba-0274-41fc-bffb-9210a761fada" released by "delete_volume" :: held 1.891s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG cinder.quota [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Created reservations ['937b48a9-a8e9-44d1-901c-b8167b231f55', '9fa0630d-2688-4754-8efe-33fb00370c3d', '020361fc-befa-4e8d-8eb6-bb5a589a8f1f', '4372dcb9-4f60-46d8-9a7f-62da05e2600b'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:29 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:29 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:29 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" returned: 0 in 0.517s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:29 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 is being set with open permissions: ugo+rw Feb 27 12:33:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:30 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 Feb 27 12:33:30 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:30 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.496s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG cinder.manager [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Deleted volume successfully. Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-3bbdf6cb-c027-4d37-8437-3a519e6b2a1b req-fd9acfd6-04d3-46eb-974e-c7fbd97b2d1b tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-644ad2ba-0274-41fc-bffb-9210a761fada-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:30 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" returned: 0 in 0.486s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.182s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Creating offline snapshot 866fd007-39c2-487b-bca5-4f8eca3a9763 of volume ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-16c145f0-7cf9-4a21-a784-bc6d72b748ba tempest-VolumesDeleteCascade-2020851104 None] Create snapshot completed successfully Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e79e2-f902-4743-bb8c-636223a1b1e5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:30 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f Feb 27 12:33:30 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:31 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f" returned: 0 in 0.643s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 1G Feb 27 12:33:31 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-a8f00af7-53ed-47c9-a79c-ddc3c966baaa-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-a8f00af7-53ed-47c9-a79c-ddc3c966baaa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Performing cascade delete. {{(pid=83114) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-1c2f5e84-fa5a-42d9-8f6a-d479d5dac076-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-1c2f5e84-fa5a-42d9-8f6a-d479d5dac076-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Deleting offline snapshot 1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 of volume a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] snapshot_file for this snap is: volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[352602c8-c956-482b-89a1-960707752cd6]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 Feb 27 12:33:31 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:31 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 1G" returned: 0 in 0.606s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:31 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 Feb 27 12:33:31 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:32 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" returned: 0 in 0.825s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:32 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee506e1-7b3a-4ede-b0c3-82be49e9f22b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:32 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 Feb 27 12:33:32 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:32 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763" returned: 0 in 0.770s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:32 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 is being set with open permissions: ugo+rw Feb 27 12:33:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:32 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 Feb 27 12:33:32 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:32 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125" returned: 0 in 0.707s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:33 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 Feb 27 12:33:33 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:33 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763" returned: 0 in 0.724s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:33 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.info Feb 27 12:33:33 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:33 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" returned: 0 in 0.743s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:33 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076 Feb 27 12:33:33 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:33 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.info" returned: 0 in 0.636s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:33 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.info is being set with open permissions: ugo+rw Feb 27 12:33:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.info Feb 27 12:33:34 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:34 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" returned: 0 in 0.603s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-1c2f5e84-fa5a-42d9-8f6a-d479d5dac076" released by "_delete_snapshot" :: held 2.950s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" released by "delete_snapshot" :: held 2.966s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Created reservations ['e8f74471-49a8-46a1-8e6b-5f3da72c9495', 'c3fa6447-ec87-4bd4-9037-71e9ed6e0558', '866ff9b3-4981-4326-9738-2a0ade77ebe7', '3c893534-87ff-480b-8b8a-360a880a0ee1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Delete snapshot completed successfully. Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-1c2f5e84-fa5a-42d9-8f6a-d479d5dac076-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-7fcce365-b432-47c8-b75f-0a333aac6125-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-7fcce365-b432-47c8-b75f-0a333aac6125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:34 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.info" returned: 0 in 0.542s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.031s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-7fcce365-b432-47c8-b75f-0a333aac6125" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-7fcce365-b432-47c8-b75f-0a333aac6125" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Deleting offline snapshot 7fcce365-b432-47c8-b75f-0a333aac6125 of volume a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] snapshot_file for this snap is: volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8f5b51eb-beae-49cc-83a9-9fe92c392492 tempest-VolumesSnapshotListTestJSON-222570537 None] Create snapshot completed successfully Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26715cf-1388-447a-89f4-524caa671b8a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:34 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 Feb 27 12:33:34 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125" returned: 0 in 0.542s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a2d69-d33d-4825-ace6-29be0acf9c9f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:35 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa Feb 27 12:33:35 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Creating offline snapshot 0252dc0d-7efd-4aab-963a-f7196e3e88a0 of volume ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a1a19c-d797-4039-83bd-85a64adb19d7]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:35 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" returned: 0 in 0.698s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:35 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 Feb 27 12:33:35 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:35 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 Feb 27 12:33:35 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:36 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125" returned: 0 in 0.528s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:36 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125 Feb 27 12:33:36 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:36 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763" returned: 0 in 0.766s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:36 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 1G Feb 27 12:33:36 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:36 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa.7fcce365-b432-47c8-b75f-0a333aac6125" returned: 0 in 0.558s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-7fcce365-b432-47c8-b75f-0a333aac6125" released by "_delete_snapshot" :: held 2.393s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" released by "delete_snapshot" :: held 2.411s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Created reservations ['5de44df8-c0a9-4be1-a8f7-3895d37ebdad', '65b246b3-df77-420f-9a06-523432fdf88e', '7aee59db-22e1-4556-89c4-cd9c270ee9f9', '9111a1b7-eefb-4dd5-9be4-2c9e9d2d2cb8'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Delete snapshot completed successfully. Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-7fcce365-b432-47c8-b75f-0a333aac6125-delete_snapshot" released by "delete_snapshot" :: held 2.639s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Snapshots deleted, issuing volume delete {{(pid=83114) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[48abafaf-0408-46f3-9341-735fd98da2a2]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 1G" returned: 0 in 0.717s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa Feb 27 12:33:37 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 Feb 27 12:33:37 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" returned: 0 in 0.816s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:37 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa Feb 27 12:33:37 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:37 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0" returned: 0 in 0.706s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:37 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 is being set with open permissions: ugo+rw Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:38 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 Feb 27 12:33:38 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:38 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" returned: 0 in 0.524s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-a8f00af7-53ed-47c9-a79c-ddc3c966baaa" released by "delete_volume" :: held 1.379s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:38 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b4f872db-9f68-4785-b592-aaeb35cfb41f tempest-VolumesSnapshotListTestJSON-222570537 None] Create snapshot completed successfully Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Created reservations ['a73bec27-e370-4ec7-89dd-ec12246c2943', '85a27ece-76d7-4814-992a-74158d4fd745', '360e8388-e687-493f-928f-3ec397bed1c0', '4e0a9f5e-b066-4b77-8454-2d101a8d8c17'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:38 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:38 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Creating offline snapshot e3b024e9-df26-47eb-b9e8-85946711d0b2 of volume ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e6cad8-c177-403f-88ee-463c36ac9c8a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:39 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 Feb 27 12:33:39 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:39 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.759s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:39 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Deleted volume successfully. Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd1a9edc-dd0f-4cda-aeba-d505f594488d tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-a8f00af7-53ed-47c9-a79c-ddc3c966baaa-delete_volume" released by "delete_volume" :: held 8.157s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Flow 'volume_create_manager' (5242d3f0-8ccb-4050-b38f-6da27bf00c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b37eb6-5bb5-40a8-99b9-0bd5ace9fe8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b37eb6-5bb5-40a8-99b9-0bd5ace9fe8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-359886477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef05fa9-774c-43e9-aa04-781a452e51ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc5174c509549e98bf74fec79ff304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:40Z,use_quota=True,user_id='24887e0d3b294b3fa54de6e937a5a25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4766c20-39b3-4231-8058-84174fdae6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4766c20-39b3-4231-8058-84174fdae6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5ef49-9449-49fd-87a0-a066b1b281c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5ef49-9449-49fd-87a0-a066b1b281c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef05fa9-774c-43e9-aa04-781a452e51ac', 'volume_name': 'volume-bef05fa9-774c-43e9-aa04-781a452e51ac', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541dfebf-3591-499d-969e-91a4e0faee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541dfebf-3591-499d-969e-91a4e0faee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f05535-078a-4b18-9368-8740eb173ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:39 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Volume bef05fa9-774c-43e9-aa04-781a452e51ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef05fa9-774c-43e9-aa04-781a452e51ac', 'volume_size': 1} Feb 27 12:33:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:40 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0" returned: 0 in 0.842s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:40 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 1G Feb 27 12:33:40 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:40 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 1G" returned: 0 in 0.775s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:40 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 Feb 27 12:33:40 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:41 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2" returned: 0 in 0.490s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:41 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 is being set with open permissions: ugo+rw Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:41 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 Feb 27 12:33:41 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-6cd7d8d2-f0e3-46b5-8e28-5150d755e24e tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Terminate volume connection completed successfully. Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-6cd7d8d2-f0e3-46b5-8e28-5150d755e24e tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Deleting attachment 38fb9413-c450-46c4-b25c-3abb19775729. {{(pid=83114) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 12:33:41 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2" returned: 0 in 0.535s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.749s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-359886477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef05fa9-774c-43e9-aa04-781a452e51ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc5174c509549e98bf74fec79ff304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:40Z,use_quota=True,user_id='24887e0d3b294b3fa54de6e937a5a25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Creating volume bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:41 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:41 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac 1073741824 Feb 27 12:33:41 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9e71eaa7-b860-4018-b130-c6c45253fe9c tempest-VolumesSnapshotListTestJSON-222570537 None] Create snapshot completed successfully Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "cinder-2316f2b6-efd4-42c8-95e3-53499fb383e6-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-2316f2b6-efd4-42c8-95e3-53499fb383e6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "cinder-quobyte-2316f2b6-efd4-42c8-95e3-53499fb383e6" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-quobyte-2316f2b6-efd4-42c8-95e3-53499fb383e6" acquired by "delete_volume" :: waited 0.027s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2296d7-80f0-487e-9100-99c27d3135b2]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:42 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 Feb 27 12:33:42 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:42 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac 1073741824" returned: 0 in 0.787s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:42 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac Feb 27 12:33:42 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:43 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6" returned: 0 in 0.919s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:43 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6 Feb 27 12:33:43 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-e3b024e9-df26-47eb-b9e8-85946711d0b2-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-e3b024e9-df26-47eb-b9e8-85946711d0b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-quobyte-e3b024e9-df26-47eb-b9e8-85946711d0b2" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-e3b024e9-df26-47eb-b9e8-85946711d0b2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Deleting offline snapshot e3b024e9-df26-47eb-b9e8-85946711d0b2 of volume ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] snapshot_file for this snap is: volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe668a6-d141-425f-8ea7-da2c4867db50]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:43 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac" returned: 0 in 0.936s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f05535-078a-4b18-9368-8740eb173ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef05fa9-774c-43e9-aa04-781a452e51ac', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4d6e54-6b83-48d6-a7dc-feddeaf77d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:43 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Volume volume-bef05fa9-774c-43e9-aa04-781a452e51ac (bef05fa9-774c-43e9-aa04-781a452e51ac): created successfully Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4d6e54-6b83-48d6-a7dc-feddeaf77d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Flow 'volume_create_manager' (5242d3f0-8ccb-4050-b38f-6da27bf00c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-737d4f75-f1db-4304-b6c8-f5d36370baf4 tempest-VolumesDeleteCascade-2020851104 None] Created volume successfully. Feb 27 12:33:43 devstack sudo[87381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 Feb 27 12:33:43 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:43 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2316f2b6-efd4-42c8-95e3-53499fb383e6" returned: 0 in 0.504s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-quobyte-2316f2b6-efd4-42c8-95e3-53499fb383e6" released by "delete_volume" :: held 1.473s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.quota [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Created reservations ['e3c36fd5-3f9d-4f5e-b1e7-76230a3262ef', '0a011d31-2c32-478f-9ca1-cc69fe93eacc', 'b3a45ad4-4cef-41fd-a02f-9d02284f9abd', '3ea8c3ea-9905-4675-b834-c31578c811a7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:43 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:43 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Flow 'volume_create_manager' (2676298e-2ecd-4ffe-b1a5-131e45bfaf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf7f204-9b7e-481c-b855-e4c22aad4df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf7f204-9b7e-481c-b855-e4c22aad4df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1896573532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f84e8f2-f46e-4a01-a19e-bdd3ff12454b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5faadcd0f7447fe8f3330f3f9f57b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:44Z,use_quota=True,user_id='a7f2e269218845eca9d2b151436583fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f24814b-0854-4442-bf05-58e589413f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f24814b-0854-4442-bf05-58e589413f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec604142-5c49-4cce-9c7d-85492ab17747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec604142-5c49-4cce-9c7d-85492ab17747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f84e8f2-f46e-4a01-a19e-bdd3ff12454b', 'volume_name': 'volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32df37ce-1793-4ef1-9ac4-315f55c6bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32df37ce-1793-4ef1-9ac4-315f55c6bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e9b4cd-9bd2-4463-a390-aea0c0d33918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:44 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Volume 6f84e8f2-f46e-4a01-a19e-bdd3ff12454b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b', 'volume_size': 1} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1896573532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f84e8f2-f46e-4a01-a19e-bdd3ff12454b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5faadcd0f7447fe8f3330f3f9f57b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:44Z,use_quota=True,user_id='a7f2e269218845eca9d2b151436583fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Creating volume 6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:44 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:44 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b 1073741824 Feb 27 12:33:44 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:44 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2" returned: 0 in 0.695s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3429de7-623c-4d18-be0d-638367807ccb]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:44 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.manager [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:44 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 Feb 27 12:33:44 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:44 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Deleted volume successfully. Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-c994de63-20a9-47c6-95db-dfe3c6c2c9a5 req-bb969a1b-c72e-4e50-81e9-4165005820b2 tempest-ServerBootFromVolumeStableRescueTest-978880326 None] Lock "cinder-2316f2b6-efd4-42c8-95e3-53499fb383e6-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:44 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b 1073741824" returned: 0 in 0.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:44 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0" returned: 0 in 0.525s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:44 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:33:44 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:44 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 Feb 27 12:33:44 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:45 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 0.450s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.026s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e9b4cd-9bd2-4463-a390-aea0c0d33918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b980d4-a97e-49d3-abb4-36085e06ed29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:45 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Volume volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b (6f84e8f2-f46e-4a01-a19e-bdd3ff12454b): created successfully Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b980d4-a97e-49d3-abb4-36085e06ed29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Flow 'volume_create_manager' (2676298e-2ecd-4ffe-b1a5-131e45bfaf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:45 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ab91d256-5126-4e1b-ab60-1faceb117f45 tempest-VolumesActionsTest-1915366989 None] Created volume successfully. Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Creating offline snapshot ab68abe8-cd31-4781-9f01-fdfbb32d0f8f of volume bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffd7032-4195-4945-ac42-422ba43085ba]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:45 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac Feb 27 12:33:45 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:45 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2" returned: 0 in 0.610s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:45 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2 Feb 27 12:33:45 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:45 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:45 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac" returned: 0 in 0.582s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.e3b024e9-df26-47eb-b9e8-85946711d0b2" returned: 0 in 0.493s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:45 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f 1G Feb 27 12:33:45 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-e3b024e9-df26-47eb-b9e8-85946711d0b2" released by "_delete_snapshot" :: held 2.390s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" released by "delete_snapshot" :: held 2.402s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Created reservations ['2200c3b8-0c0a-4acf-9571-a86efcea09b1', '6e5df8ff-493a-4187-9e7a-e1e4bae1470f', '6e96fe7d-e2e8-4f6d-822a-07a0122f5952', 'be389d00-04f9-4f0d-95b3-a4f407f75fa7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:46 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Delete snapshot completed successfully. Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-362e5bf7-b1f2-4c6c-95da-d7610b40144d tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-e3b024e9-df26-47eb-b9e8-85946711d0b2-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:46 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f 1G" returned: 0 in 0.550s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bef05fa9-774c-43e9-aa04-781a452e51ac -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:46 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bef05fa9-774c-43e9-aa04-781a452e51ac -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f Feb 27 12:33:46 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-0252dc0d-7efd-4aab-963a-f7196e3e88a0-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-0252dc0d-7efd-4aab-963a-f7196e3e88a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-quobyte-0252dc0d-7efd-4aab-963a-f7196e3e88a0" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-0252dc0d-7efd-4aab-963a-f7196e3e88a0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Deleting offline snapshot 0252dc0d-7efd-4aab-963a-f7196e3e88a0 of volume ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] snapshot_file for this snap is: volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559754a-3e07-47e6-b94d-eac160359a09]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:46 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 Feb 27 12:33:46 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:47 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bef05fa9-774c-43e9-aa04-781a452e51ac -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" returned: 0 in 0.761s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:47 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f is being set with open permissions: ugo+rw Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:47 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f Feb 27 12:33:47 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:47 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0" returned: 0 in 0.755s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c24a4e-c697-4631-b3a7-3d478c461813]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:47 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 Feb 27 12:33:47 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:47 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" returned: 0 in 0.546s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:47 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.info Feb 27 12:33:47 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:48 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763" returned: 0 in 0.629s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:48 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 Feb 27 12:33:48 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:48 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.info" returned: 0 in 0.561s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:48 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.info is being set with open permissions: ugo+rw Feb 27 12:33:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:48 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.info Feb 27 12:33:48 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:48 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0" returned: 0 in 0.669s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:48 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0 Feb 27 12:33:48 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:49 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.info" returned: 0 in 0.641s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.751s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:49 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-05e0d8be-3e2d-4839-b4b7-38380f35e637 tempest-VolumesDeleteCascade-2020851104 None] Create snapshot completed successfully Feb 27 12:33:49 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.0252dc0d-7efd-4aab-963a-f7196e3e88a0" returned: 0 in 0.453s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-0252dc0d-7efd-4aab-963a-f7196e3e88a0" released by "_delete_snapshot" :: held 2.571s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" released by "delete_snapshot" :: held 2.594s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Created reservations ['15d39d4c-9fa3-431f-8461-96737ccbb49f', 'a1a08d06-ed7e-417c-ae77-f2aacf38fd9b', '5eaa8a4a-ccfe-40d7-8251-96aac0cf18e8', '4807bb54-c263-4b5d-b830-3ba7799ac0c1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:49 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Delete snapshot completed successfully. Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec2e7baf-8a04-49cb-a462-9ece8604f461 tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-0252dc0d-7efd-4aab-963a-f7196e3e88a0-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Flow 'volume_create_manager' (24728361-c76d-46d4-8be1-97c87ed26295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510a0ebf-e202-40c8-92ff-84ccd5405eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510a0ebf-e202-40c8-92ff-84ccd5405eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-180060014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f044d148-8cd4-44a4-9ad2-bcfeece59a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc5174c509549e98bf74fec79ff304d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab68abe8-cd31-4781-9f01-fdfbb32d0f8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:33:50Z,use_quota=True,user_id='24887e0d3b294b3fa54de6e937a5a25f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33eaaa32-6540-4788-a9bd-f0c060fab697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33eaaa32-6540-4788-a9bd-f0c060fab697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9422a351-894e-4e15-8df1-019a113b8fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9422a351-894e-4e15-8df1-019a113b8fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f044d148-8cd4-44a4-9ad2-bcfeece59a31', 'volume_name': 'volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31', 'volume_size': 1, 'snapshot_id': 'ab68abe8-cd31-4781-9f01-fdfbb32d0f8f'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ab4abd-07f6-4589-9d77-b0f88f7c7206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ab4abd-07f6-4589-9d77-b0f88f7c7206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bfdeeb-c8c7-4891-98dd-cab21c0a7780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:49 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Volume f044d148-8cd4-44a4-9ad2-bcfeece59a31: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31', 'volume_size': 1, 'snapshot_id': 'ab68abe8-cd31-4781-9f01-fdfbb32d0f8f'} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f-f044d148-8cd4-44a4-9ad2-bcfeece59a31" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f-f044d148-8cd4-44a4-9ad2-bcfeece59a31" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Creating volume f044d148-8cd4-44a4-9ad2-bcfeece59a31 from snapshot ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-f044d148-8cd4-44a4-9ad2-bcfeece59a31" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-f044d148-8cd4-44a4-9ad2-bcfeece59a31" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] snapshot: ab68abe8-cd31-4781-9f01-fdfbb32d0f8f, volume: f044d148-8cd4-44a4-9ad2-bcfeece59a31, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71cf670-9868-4d88-9511-75332ca25c8a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-866fd007-39c2-487b-bca5-4f8eca3a9763-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:49 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f Feb 27 12:33:49 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-866fd007-39c2-487b-bca5-4f8eca3a9763-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-quobyte-866fd007-39c2-487b-bca5-4f8eca3a9763" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-866fd007-39c2-487b-bca5-4f8eca3a9763" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Deleting offline snapshot 866fd007-39c2-487b-bca5-4f8eca3a9763 of volume ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] snapshot_file for this snap is: volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbcd3e8-31a6-4ad2-b198-c71f3a7c4e88]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:50 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 Feb 27 12:33:50 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:50 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" returned: 0 in 0.582s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bef05fa9-774c-43e9-aa04-781a452e51ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43441f3-e716-42d4-81b2-493cad365c91]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:50 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac Feb 27 12:33:50 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:50 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763" returned: 0 in 0.525s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d507c4-e517-40c0-ae1d-ca52b2c5ed6f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:50 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f Feb 27 12:33:50 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:50 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac" returned: 0 in 0.532s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:33:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:51 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 Feb 27 12:33:51 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:51 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f" returned: 0 in 0.524s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:51 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 Feb 27 12:33:51 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:51 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763" returned: 0 in 0.859s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:52 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763 Feb 27 12:33:52 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:53 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f.866fd007-39c2-487b-bca5-4f8eca3a9763" returned: 0 in 1.805s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:53 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:UPDATE=132,cinder:DELETE=12,cinder:SELECT=122,cinder:INSERT=36 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:33:53 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=129,cinder:INSERT=48,cinder:UPDATE=125,cinder:DELETE=12 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:33:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-866fd007-39c2-487b-bca5-4f8eca3a9763" released by "_delete_snapshot" :: held 3.884s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" released by "delete_snapshot" :: held 3.906s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Created reservations ['3fc7c287-cedf-4927-b155-949bc13b542a', 'be0e8841-9e13-4d7a-aa68-9ced0263446c', '7d8cbf03-c0db-4535-9e4f-851a1eb1ea72', '1c780b1b-b3d7-4474-97f6-904b19b9ae00'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:54 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31" returned: 0 in 3.049s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[002eb88a-8f68-4958-be00-d3709e70b15e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:54 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Delete snapshot completed successfully. Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-54595590-5842-4654-bc49-e19c9c0fde8e tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-866fd007-39c2-487b-bca5-4f8eca3a9763-delete_snapshot" released by "delete_snapshot" :: held 4.144s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:54 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac Feb 27 12:33:54 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-ce62f905-1d7d-4002-8ad4-8394261ceb3f-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-ce62f905-1d7d-4002-8ad4-8394261ceb3f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[60033346-2cf2-4ec9-805b-8b5d9a5ba47b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:54 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f Feb 27 12:33:54 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:54 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac" returned: 0 in 0.923s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac, size 1024.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:33:54 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Converted 1024.00 MB image at 335.74 MB/s Feb 27 12:33:54 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 is being set with open permissions: ugo+rw Feb 27 12:33:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:55 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 Feb 27 12:33:55 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:55 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f" returned: 0 in 0.662s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:55 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f Feb 27 12:33:55 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:55 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31" returned: 0 in 0.498s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-f044d148-8cd4-44a4-9ad2-bcfeece59a31" released by "_copy_volume_from_snapshot" :: held 5.657s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f-f044d148-8cd4-44a4-9ad2-bcfeece59a31" released by "_create_volume_from_snapshot" :: held 5.677s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.687s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bfdeeb-c8c7-4891-98dd-cab21c0a7780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31', 'volume_size': 1, 'snapshot_id': 'ab68abe8-cd31-4781-9f01-fdfbb32d0f8f'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aa07a8-18e1-49ac-894b-4b0bb8e0799d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:55 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Volume volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 (f044d148-8cd4-44a4-9ad2-bcfeece59a31): created successfully Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09aa07a8-18e1-49ac-894b-4b0bb8e0799d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Flow 'volume_create_manager' (24728361-c76d-46d4-8be1-97c87ed26295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:55 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e918f2d2-185d-46f1-a692-ffdc2775f3d9 tempest-VolumesDeleteCascade-2020851104 None] Created volume successfully. Feb 27 12:33:55 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce62f905-1d7d-4002-8ad4-8394261ceb3f" returned: 0 in 0.505s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-quobyte-ce62f905-1d7d-4002-8ad4-8394261ceb3f" released by "delete_volume" :: held 1.215s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Created reservations ['f418bd7e-9dc5-4236-ba97-36930b1924eb', '18c1d649-3fae-4f08-a0e5-867fcc8678ef', 'd11b5cf5-1c63-49cb-b1f4-77979f11dfce', 'aab8d482-7168-4324-8b0a-03e043332541'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:55 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:33:55 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:56 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.490s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:33:56 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Deleted volume successfully. Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ab764670-09b3-4d57-9afb-be0a2fe354ea tempest-VolumesSnapshotListTestJSON-222570537 None] Lock "cinder-ce62f905-1d7d-4002-8ad4-8394261ceb3f-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-bef05fa9-774c-43e9-aa04-781a452e51ac-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-bef05fa9-774c-43e9-aa04-781a452e51ac-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Performing cascade delete. {{(pid=83114) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-bef05fa9-774c-43e9-aa04-781a452e51ac" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-bef05fa9-774c-43e9-aa04-781a452e51ac" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Deleting offline snapshot ab68abe8-cd31-4781-9f01-fdfbb32d0f8f of volume bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] snapshot_file for this snap is: volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f0c291-7250-453f-b3b9-0ef831a1440d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:56 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f Feb 27 12:33:56 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:57 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" returned: 0 in 0.633s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bef05fa9-774c-43e9-aa04-781a452e51ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:33:57 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc47ab0c-5895-4af6-a942-76d8d7b3d2ab]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:57 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac Feb 27 12:33:57 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac" returned: 0 in 0.656s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:58 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:58 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f Feb 27 12:33:58 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:58 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" returned: 0 in 0.653s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:58 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f Feb 27 12:33:58 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:59 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac.ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" returned: 0 in 0.578s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f" released by "_delete_snapshot" :: held 2.578s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-bef05fa9-774c-43e9-aa04-781a452e51ac" released by "delete_snapshot" :: held 2.604s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Created reservations ['98965690-654f-4558-96ac-4e8168b0e430', '7053ebb2-20da-42be-bcf1-5eb27b2fc495', '63843269-78bb-4601-986b-9905bd7b319c', 'c31c5691-b017-4a6d-b824-33012081a159'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:33:59 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Delete snapshot completed successfully. Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-ab68abe8-cd31-4781-9f01-fdfbb32d0f8f-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Snapshots deleted, issuing volume delete {{(pid=83114) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-bef05fa9-774c-43e9-aa04-781a452e51ac" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-bef05fa9-774c-43e9-aa04-781a452e51ac" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2cecf8-5054-4f66-8770-1ed40acd1f79]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (cd8c422a-cbd4-476a-ab1c-130b7b4547ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5961f594-17f9-4cf5-b692-c8d152c1e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5961f594-17f9-4cf5-b692-c8d152c1e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1803184362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fbf46b-a43d-45bd-873e-d29c37532a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:00Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9dd525-8ac6-48fe-a325-94863d91f54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9dd525-8ac6-48fe-a325-94863d91f54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5cc736-408a-4eb5-a7ce-57193a6512b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5cc736-408a-4eb5-a7ce-57193a6512b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fbf46b-a43d-45bd-873e-d29c37532a22', 'volume_name': 'volume-f9fbf46b-a43d-45bd-873e-d29c37532a22', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa22df81-5732-4973-9219-d06c766bb728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa22df81-5732-4973-9219-d06c766bb728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab432a3-4fa9-4596-934f-db8ffb2bc0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:33:59 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume f9fbf46b-a43d-45bd-873e-d29c37532a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fbf46b-a43d-45bd-873e-d29c37532a22', 'volume_size': 1} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1803184362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fbf46b-a43d-45bd-873e-d29c37532a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:00Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Creating volume f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:33:59 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:33:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:33:59 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac Feb 27 12:33:59 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:33:59 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 1073741824 Feb 27 12:33:59 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:00 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac" returned: 0 in 1.168s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:00 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac Feb 27 12:34:00 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:00 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 1073741824" returned: 0 in 1.141s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:00 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 Feb 27 12:34:00 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:01 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bef05fa9-774c-43e9-aa04-781a452e51ac" returned: 0 in 0.635s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-bef05fa9-774c-43e9-aa04-781a452e51ac" released by "delete_volume" :: held 1.852s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Created reservations ['2f931499-8152-4cf5-9bc7-4e9ded3ba606', '35c9d8c3-9345-4ffd-9c8a-4542ed8d3dc6', '38e9bb61-b3b8-4e06-a6de-6e5c6d353780', 'cf977e79-02af-48b5-9f91-50e849b4e7b5'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:01 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22" returned: 0 in 0.625s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab432a3-4fa9-4596-934f-db8ffb2bc0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fbf46b-a43d-45bd-873e-d29c37532a22', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63548f8c-05cf-4c3f-b51a-c9a06f3cef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:01 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 (f9fbf46b-a43d-45bd-873e-d29c37532a22): created successfully Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63548f8c-05cf-4c3f-b51a-c9a06f3cef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (cd8c422a-cbd4-476a-ab1c-130b7b4547ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:01 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-06a91be9-10d6-4ef8-bb19-f8d7ad274db3 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created volume successfully. Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:01 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:01 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Creating offline snapshot 5aa7657e-08e1-4b8a-9f6c-272f51b8d515 of volume f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c217c694-dfc3-4d22-ab9b-8df03ecf9da0 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" by "attach_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c217c694-dfc3-4d22-ab9b-8df03ecf9da0 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" acquired by "attach_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9762011-1746-40f4-aa5a-3f9f4a5727b5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:02 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c217c694-dfc3-4d22-ab9b-8df03ecf9da0 tempest-VolumesActionsTest-1915366989 None] Attaching volume 6f84e8f2-f46e-4a01-a19e-bdd3ff12454b to instance 8b3b6a22-a189-4912-954e-9c032ffe232b at mountpoint /dev/vdb on host None. Feb 27 12:34:02 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c217c694-dfc3-4d22-ab9b-8df03ecf9da0 tempest-VolumesActionsTest-1915366989 None] Attach volume completed successfully. Feb 27 12:34:02 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 Feb 27 12:34:02 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c217c694-dfc3-4d22-ab9b-8df03ecf9da0 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" released by "attach_volume" :: held 0.197s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:02 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.795s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:02 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Deleted volume successfully. Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39198bd7-3f48-4e7a-88d8-78364bc7a1cc tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-bef05fa9-774c-43e9-aa04-781a452e51ac-delete_volume" released by "delete_volume" :: held 5.636s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-f044d148-8cd4-44a4-9ad2-bcfeece59a31-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-f044d148-8cd4-44a4-9ad2-bcfeece59a31-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "cinder-quobyte-f044d148-8cd4-44a4-9ad2-bcfeece59a31" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-f044d148-8cd4-44a4-9ad2-bcfeece59a31" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5a8f8-a06e-47db-848a-8d97b78a96a4]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:02 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 Feb 27 12:34:02 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8000c21f-09d3-4d4e-900e-b7b6f0473af5 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-detach_volume" by "detach_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8000c21f-09d3-4d4e-900e-b7b6f0473af5 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:02 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8000c21f-09d3-4d4e-900e-b7b6f0473af5 tempest-VolumesActionsTest-1915366989 None] Detaching volume 6f84e8f2-f46e-4a01-a19e-bdd3ff12454b from instance 8b3b6a22-a189-4912-954e-9c032ffe232b. Feb 27 12:34:02 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8000c21f-09d3-4d4e-900e-b7b6f0473af5 tempest-VolumesActionsTest-1915366989 None] Detach volume completed successfully. Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8000c21f-09d3-4d4e-900e-b7b6f0473af5 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:02 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22" returned: 0 in 0.735s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:02 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 1G Feb 27 12:34:02 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:03 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31" returned: 0 in 0.649s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:03 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31 Feb 27 12:34:03 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:03 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 1G" returned: 0 in 0.712s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:03 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 Feb 27 12:34:03 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:03 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f044d148-8cd4-44a4-9ad2-bcfeece59a31" returned: 0 in 0.693s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-quobyte-f044d148-8cd4-44a4-9ad2-bcfeece59a31" released by "delete_volume" :: held 1.375s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:03 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Created reservations ['e2ee8720-c6f5-45a1-b9f7-1ff723ec72a2', '22cac692-449d-4a03-8f8f-9303ebe989ae', 'e87a0dc3-49f3-4033-bc79-5c6d6df95381', '39af2572-adb8-49d2-bd10-3b432241e974'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:04 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:04 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:04 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515" returned: 0 in 0.624s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:04 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 is being set with open permissions: ugo+rw Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:04 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 Feb 27 12:34:04 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:04 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.751s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:04 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Deleted volume successfully. Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39a3f0a6-0d57-4102-a2bf-169e42423b19 tempest-VolumesDeleteCascade-2020851104 None] Lock "cinder-f044d148-8cd4-44a4-9ad2-bcfeece59a31-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:04 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515" returned: 0 in 0.786s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:05 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.info Feb 27 12:34:05 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:05 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.info" returned: 0 in 0.584s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:05 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.info is being set with open permissions: ugo+rw Feb 27 12:34:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:05 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.info Feb 27 12:34:05 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:06 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.info" returned: 0 in 0.485s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.068s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:06 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e63cfffe-a96e-4511-bb8b-66b3df138942 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Create snapshot completed successfully Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (4d757176-6a57-4a3a-a9f8-d47161ce8a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd921876-d248-4e21-9a77-077a76a524ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd921876-d248-4e21-9a77-077a76a524ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610645602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7785143-92f8-4052-9091-7f4bc0f0c819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:06Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724417ad-4264-4730-bd74-1de300e56647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724417ad-4264-4730-bd74-1de300e56647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f9aa1a-b240-406e-9b33-0cc79df3af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f9aa1a-b240-406e-9b33-0cc79df3af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7785143-92f8-4052-9091-7f4bc0f0c819', 'volume_name': 'volume-f7785143-92f8-4052-9091-7f4bc0f0c819', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e726930-e9b1-4899-909c-f452493444ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e726930-e9b1-4899-909c-f452493444ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5beba0-98a0-41a4-a593-b0f2b9f35206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume f7785143-92f8-4052-9091-7f4bc0f0c819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7785143-92f8-4052-9091-7f4bc0f0c819', 'volume_size': 1} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610645602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7785143-92f8-4052-9091-7f4bc0f0c819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:06Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Creating volume f7785143-92f8-4052-9091-7f4bc0f0c819 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:06 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:06 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 1073741824 Feb 27 12:34:06 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (29419d45-1c6c-4852-827f-b0a2e5153aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90a29dd-7145-4f87-9128-19009c7a7368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90a29dd-7145-4f87-9128-19009c7a7368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101852560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c847fd-6946-4636-825a-c1dcd190aa24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:07Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b915be9-f790-49b0-a505-cabf79e860e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b915be9-f790-49b0-a505-cabf79e860e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e1a21f-f86c-4645-a479-6789dabc31ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e1a21f-f86c-4645-a479-6789dabc31ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c847fd-6946-4636-825a-c1dcd190aa24', 'volume_name': 'volume-07c847fd-6946-4636-825a-c1dcd190aa24', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ee876d-e23a-455f-b38b-72350ea2c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ee876d-e23a-455f-b38b-72350ea2c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d801a938-ec26-4402-8cb5-d595108d6f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:06 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume 07c847fd-6946-4636-825a-c1dcd190aa24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c847fd-6946-4636-825a-c1dcd190aa24', 'volume_size': 1} Feb 27 12:34:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (bb276800-0300-4ca4-bc86-632621883a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2bf4ff-1f44-4eaf-9aea-0dee963f9ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:07 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 1073741824" returned: 0 in 0.748s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:07 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2bf4ff-1f44-4eaf-9aea-0dee963f9ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746968696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de9afb7-4a53-4c01-9386-93cc82ea5491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:07Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1808e75e-9b94-4ef2-89c4-48e6a9185cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1808e75e-9b94-4ef2-89c4-48e6a9185cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca44fcc8-5598-4e64-bef9-2365a0092a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca44fcc8-5598-4e64-bef9-2365a0092a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de9afb7-4a53-4c01-9386-93cc82ea5491', 'volume_name': 'volume-1de9afb7-4a53-4c01-9386-93cc82ea5491', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddf370d-16e8-44a5-8dc8-040972b1cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddf370d-16e8-44a5-8dc8-040972b1cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ec325f-f5af-4613-ab43-5bb4363bd58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume 1de9afb7-4a53-4c01-9386-93cc82ea5491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de9afb7-4a53-4c01-9386-93cc82ea5491', 'volume_size': 1} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:07 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 Feb 27 12:34:07 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (5cca94fe-ff94-432c-8f86-24c480f11d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b56f78-0f07-45c0-8328-f8e799d70f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b56f78-0f07-45c0-8328-f8e799d70f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609709588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0d4a54-93af-4e3a-8be0-6b61102787b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:08Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e20094d-be9b-4cc5-9216-4ae0bd07ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e20094d-be9b-4cc5-9216-4ae0bd07ab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ada0f0-3046-497a-94f9-9c26ec635b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ada0f0-3046-497a-94f9-9c26ec635b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0d4a54-93af-4e3a-8be0-6b61102787b0', 'volume_name': 'volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972af87c-2626-4e16-928f-8bc2366704fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972af87c-2626-4e16-928f-8bc2366704fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf49ea1-b428-4b02-a2d6-949dad8b9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:07 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume aa0d4a54-93af-4e3a-8be0-6b61102787b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0', 'volume_size': 1} Feb 27 12:34:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (61b9c85b-994a-4f03-a69f-58921e23402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207459cf-109c-4a57-879d-293529b80da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207459cf-109c-4a57-879d-293529b80da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1920711971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a26eff3-57fa-466a-a8a0-087ed28b003d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:08Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ede55a-8687-4bd5-81f9-a8c9bc6e6bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ede55a-8687-4bd5-81f9-a8c9bc6e6bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc32e8c6-378f-4f6e-9e1e-248a04d70951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc32e8c6-378f-4f6e-9e1e-248a04d70951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a26eff3-57fa-466a-a8a0-087ed28b003d', 'volume_name': 'volume-8a26eff3-57fa-466a-a8a0-087ed28b003d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719162d7-7d53-4bda-b371-719ed83bea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719162d7-7d53-4bda-b371-719ed83bea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199976c3-ae49-4b82-ad3a-9b4ad1b53a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume 8a26eff3-57fa-466a-a8a0-087ed28b003d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a26eff3-57fa-466a-a8a0-087ed28b003d', 'volume_size': 1} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.873s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:08 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819" returned: 0 in 0.777s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-101852560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c847fd-6946-4636-825a-c1dcd190aa24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:07Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Creating volume 07c847fd-6946-4636-825a-c1dcd190aa24 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:08 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5beba0-98a0-41a4-a593-b0f2b9f35206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7785143-92f8-4052-9091-7f4bc0f0c819', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 1073741824 Feb 27 12:34:08 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b4aa59-8641-4ff4-9a84-2c7b9838a74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume volume-f7785143-92f8-4052-9091-7f4bc0f0c819 (f7785143-92f8-4052-9091-7f4bc0f0c819): created successfully Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b4aa59-8641-4ff4-9a84-2c7b9838a74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (4d757176-6a57-4a3a-a9f8-d47161ce8a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1142d438-ed50-4997-94b5-aeb4283e5317 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created volume successfully. Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Flow 'volume_create_manager' (23e6f568-5b89-40f0-af59-4b07e928a57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7facf847-5bec-4607-9521-e585d1e4aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7facf847-5bec-4607-9521-e585d1e4aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1473924593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3e64fd-6cf8-447c-934c-880520453cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0041f46b0f2748c9ae65865d3c6b7e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:08Z,use_quota=True,user_id='c19008c181914bb0a3d6bd116d5ca362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e551f2c-a5ac-4964-8c75-f3b156b109e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e551f2c-a5ac-4964-8c75-f3b156b109e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ff7178-8b09-4fa9-876a-a9f7f166f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ff7178-8b09-4fa9-876a-a9f7f166f62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3e64fd-6cf8-447c-934c-880520453cfa', 'volume_name': 'volume-9c3e64fd-6cf8-447c-934c-880520453cfa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d243e35-2349-4af6-a795-23329486bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d243e35-2349-4af6-a795-23329486bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6778b7e-7c08-4b90-96d8-bba5e19991fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:08 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Volume 9c3e64fd-6cf8-447c-934c-880520453cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3e64fd-6cf8-447c-934c-880520453cfa', 'volume_size': 1} Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:08 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 1073741824" returned: 0 in 0.620s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:09 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 Feb 27 12:34:09 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:09 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24" returned: 0 in 0.560s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746968696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de9afb7-4a53-4c01-9386-93cc82ea5491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:07Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Creating volume 1de9afb7-4a53-4c01-9386-93cc82ea5491 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:09 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d801a938-ec26-4402-8cb5-d595108d6f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c847fd-6946-4636-825a-c1dcd190aa24', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31615d86-66d5-450a-867b-9be40c80472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:09 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 1073741824 Feb 27 12:34:09 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:09 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume volume-07c847fd-6946-4636-825a-c1dcd190aa24 (07c847fd-6946-4636-825a-c1dcd190aa24): created successfully Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31615d86-66d5-450a-867b-9be40c80472c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (29419d45-1c6c-4852-827f-b0a2e5153aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3ccd9bd1-2016-4d20-80b5-aa01d957002f tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created volume successfully. Feb 27 12:34:10 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 1073741824" returned: 0 in 0.635s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:10 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 Feb 27 12:34:10 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:10 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491" returned: 0 in 0.555s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.978s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1609709588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0d4a54-93af-4e3a-8be0-6b61102787b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:08Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Creating volume aa0d4a54-93af-4e3a-8be0-6b61102787b0 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:10 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ec325f-f5af-4613-ab43-5bb4363bd58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de9afb7-4a53-4c01-9386-93cc82ea5491', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3180c6c-62c5-4cf4-aad8-7dec9583eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:10 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 1073741824 Feb 27 12:34:10 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:10 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 (1de9afb7-4a53-4c01-9386-93cc82ea5491): created successfully Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3180c6c-62c5-4cf4-aad8-7dec9583eff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (bb276800-0300-4ca4-bc86-632621883a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-73c85b01-80e6-4fd4-84a8-7deadbf29200 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created volume successfully. Feb 27 12:34:11 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 1073741824" returned: 0 in 0.685s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:11 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 Feb 27 12:34:11 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:12 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.856s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1920711971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a26eff3-57fa-466a-a8a0-087ed28b003d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ca1dd4e45746899e9e9758b1489232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:08Z,use_quota=True,user_id='a72cdb7078424dcb86448b758992b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Creating volume 8a26eff3-57fa-466a-a8a0-087ed28b003d {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:12 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf49ea1-b428-4b02-a2d6-949dad8b9567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf468f5-9355-40a1-9937-8cf295c8d2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:12 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d 1073741824 Feb 27 12:34:12 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:12 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 (aa0d4a54-93af-4e3a-8be0-6b61102787b0): created successfully Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf468f5-9355-40a1-9937-8cf295c8d2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (5cca94fe-ff94-432c-8f86-24c480f11d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6d838e88-33f2-46fb-a904-e092663aa671 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created volume successfully. Feb 27 12:34:12 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d 1073741824" returned: 0 in 0.647s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:12 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d Feb 27 12:34:12 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:13 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d" returned: 0 in 0.537s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.685s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1473924593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3e64fd-6cf8-447c-934c-880520453cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0041f46b0f2748c9ae65865d3c6b7e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:08Z,use_quota=True,user_id='c19008c181914bb0a3d6bd116d5ca362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Creating volume 9c3e64fd-6cf8-447c-934c-880520453cfa {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:13 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:13 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa 1073741824 Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199976c3-ae49-4b82-ad3a-9b4ad1b53a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a26eff3-57fa-466a-a8a0-087ed28b003d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cc3186-0f08-49f4-b188-f6cbb828af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:13 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:13 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Volume volume-8a26eff3-57fa-466a-a8a0-087ed28b003d (8a26eff3-57fa-466a-a8a0-087ed28b003d): created successfully Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cc3186-0f08-49f4-b188-f6cbb828af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Flow 'volume_create_manager' (61b9c85b-994a-4f03-a69f-58921e23402a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:13 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f981d501-4ef8-4dc3-8f2c-604b55288e61 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created volume successfully. Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-8a26eff3-57fa-466a-a8a0-087ed28b003d-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-8a26eff3-57fa-466a-a8a0-087ed28b003d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-8a26eff3-57fa-466a-a8a0-087ed28b003d" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-8a26eff3-57fa-466a-a8a0-087ed28b003d" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[143e0552-b0cc-4a93-bc76-f9a675f39aec]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:13 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d Feb 27 12:34:13 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:13 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa 1073741824" returned: 0 in 0.584s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:13 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa Feb 27 12:34:13 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:14 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d" returned: 0 in 0.546s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:14 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa" returned: 0 in 0.418s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:14 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:14 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6778b7e-7c08-4b90-96d8-bba5e19991fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3e64fd-6cf8-447c-934c-880520453cfa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da0d60f-87ba-4026-8c80-15f52e098627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:14 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Volume volume-9c3e64fd-6cf8-447c-934c-880520453cfa (9c3e64fd-6cf8-447c-934c-880520453cfa): created successfully Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da0d60f-87ba-4026-8c80-15f52e098627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Flow 'volume_create_manager' (23e6f568-5b89-40f0-af59-4b07e928a57c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e95a75c0-2d2a-4388-878f-3356393b9bd5 tempest-VolumesMetadataTest-55043619 None] Created volume successfully. Feb 27 12:34:14 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8a26eff3-57fa-466a-a8a0-087ed28b003d" returned: 0 in 0.469s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-8a26eff3-57fa-466a-a8a0-087ed28b003d" released by "delete_volume" :: held 1.046s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created reservations ['344263c9-a0bf-4971-ad91-41a5b1861c4c', '7d1592cf-0ebf-46ab-8532-3955090f3c46', '9d60357b-3325-45bd-862b-39c435230434', '0d31f426-6328-4836-bd02-fda009d703b8'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:14 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:14 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:15 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.461s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:15 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Deleted volume successfully. Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0c448b1f-ee58-4543-883e-e523937c40a8 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-8a26eff3-57fa-466a-a8a0-087ed28b003d-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Acquiring lock "cinder-9c3e64fd-6cf8-447c-934c-880520453cfa-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Lock "cinder-9c3e64fd-6cf8-447c-934c-880520453cfa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Acquiring lock "cinder-quobyte-9c3e64fd-6cf8-447c-934c-880520453cfa" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Lock "cinder-quobyte-9c3e64fd-6cf8-447c-934c-880520453cfa" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e83af5-fff4-4dba-b917-f065a61c7f6c]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:15 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa Feb 27 12:34:15 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-aa0d4a54-93af-4e3a-8be0-6b61102787b0-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-aa0d4a54-93af-4e3a-8be0-6b61102787b0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-aa0d4a54-93af-4e3a-8be0-6b61102787b0" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-aa0d4a54-93af-4e3a-8be0-6b61102787b0" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04d4990-04c0-4352-81ac-e51c9dec7e02]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:16 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 Feb 27 12:34:16 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa" returned: 0 in 0.543s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:16 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa Feb 27 12:34:16 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:16 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0 Feb 27 12:34:16 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-9c3e64fd-6cf8-447c-934c-880520453cfa" returned: 0 in 0.448s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Lock "cinder-quobyte-9c3e64fd-6cf8-447c-934c-880520453cfa" released by "delete_volume" :: held 1.020s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Created reservations ['73a3d99d-3da7-4e55-ad58-ac7c541a37f8', '1bd84973-2634-4bd1-a7ac-9b06aeb07de7', 'ea5d44d1-5d5d-4b9e-9864-3c9c64633095', 'cf85d69e-28be-426f-adb3-490885450669'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:16 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:16 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:16 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-aa0d4a54-93af-4e3a-8be0-6b61102787b0" returned: 0 in 0.533s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-aa0d4a54-93af-4e3a-8be0-6b61102787b0" released by "delete_volume" :: held 1.071s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created reservations ['38322543-b7a4-4abf-b83d-bca250ca689f', 'f95f585e-8edb-4d7c-8fa9-fce1e07bb31c', '3ef1ffac-7808-415f-954d-ad97703b6485', '63ec121b-1685-4305-9487-c2c6314260c8'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:17 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:17 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:17 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:17 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Deleted volume successfully. Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6328883c-dfd8-4d2a-962a-ddffaf5ee8ca tempest-VolumesMetadataTest-55043619 None] Lock "cinder-9c3e64fd-6cf8-447c-934c-880520453cfa-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:17 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.536s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:17 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Deleted volume successfully. Feb 27 12:34:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4ebd0f4a-e35a-4255-9711-e138c013c051 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-aa0d4a54-93af-4e3a-8be0-6b61102787b0-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-1de9afb7-4a53-4c01-9386-93cc82ea5491-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-1de9afb7-4a53-4c01-9386-93cc82ea5491-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-1de9afb7-4a53-4c01-9386-93cc82ea5491" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-1de9afb7-4a53-4c01-9386-93cc82ea5491" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1040e85f-83da-4ff0-9408-62b9c3c139f3]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:18 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 Feb 27 12:34:18 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:18 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491" returned: 0 in 0.780s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:18 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491 Feb 27 12:34:18 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:19 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1de9afb7-4a53-4c01-9386-93cc82ea5491" returned: 0 in 0.566s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-1de9afb7-4a53-4c01-9386-93cc82ea5491" released by "delete_volume" :: held 1.392s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created reservations ['bec560ea-3f3c-45cc-9618-c04cf5c2b0e2', 'd4514f14-15c3-4e3b-b878-698258cf1748', '487929b1-4ae9-48dd-8c7c-c2dfbf14f246', '9359a8f6-b73d-4d00-a582-63bbbfab6fef'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:19 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:19 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:20 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.677s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:20 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Deleted volume successfully. Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3f3198fc-dcb8-47f1-8dcd-6c04e0cc2f7c tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-1de9afb7-4a53-4c01-9386-93cc82ea5491-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-07c847fd-6946-4636-825a-c1dcd190aa24-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-07c847fd-6946-4636-825a-c1dcd190aa24-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-07c847fd-6946-4636-825a-c1dcd190aa24" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-07c847fd-6946-4636-825a-c1dcd190aa24" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[97588dea-2571-4b42-abcf-ad1a0b294397]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:20 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 Feb 27 12:34:20 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:21 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24" returned: 0 in 0.627s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:21 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24 Feb 27 12:34:21 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:21 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-07c847fd-6946-4636-825a-c1dcd190aa24" returned: 0 in 0.484s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-07c847fd-6946-4636-825a-c1dcd190aa24" released by "delete_volume" :: held 1.142s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created reservations ['948328ee-95bf-45e7-88b1-efadd9571ff1', '4dea01ba-5e6c-4bfa-9cb2-784c90948493', 'fb2592df-af7e-4f65-a4c3-aecb12825d2c', '874736a0-d7ee-4f13-b1d8-4c18d58b9108'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:21 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:21 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:22 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:22 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Deleted volume successfully. Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0e1d42ae-ed07-408e-bbd6-528d90f13fcc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-07c847fd-6946-4636-825a-c1dcd190aa24-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-f7785143-92f8-4052-9091-7f4bc0f0c819-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-f7785143-92f8-4052-9091-7f4bc0f0c819-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-f7785143-92f8-4052-9091-7f4bc0f0c819" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-f7785143-92f8-4052-9091-7f4bc0f0c819" acquired by "delete_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bf94e5-5675-4fef-9063-78706cddd59f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:22 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 Feb 27 12:34:22 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:23 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819" returned: 0 in 0.526s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:23 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819 Feb 27 12:34:23 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:23 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f7785143-92f8-4052-9091-7f4bc0f0c819" returned: 0 in 0.492s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-f7785143-92f8-4052-9091-7f4bc0f0c819" released by "delete_volume" :: held 1.042s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created reservations ['07652935-864c-49f3-bb10-47fbab0a6531', '24cf301a-1e8c-40c8-a3d6-dc97b5236805', '492193f2-fb96-4556-9a4c-f5b36fb68428', 'e45fd700-7ee6-4112-b0d9-6a39b7df1723'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:23 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:23 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:24 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.535s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:24 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Deleted volume successfully. Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-86e9ba30-558b-416c-9f38-bf1819bfe43a tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-f7785143-92f8-4052-9091-7f4bc0f0c819-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-5aa7657e-08e1-4b8a-9f6c-272f51b8d515-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-5aa7657e-08e1-4b8a-9f6c-272f51b8d515-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-f9fbf46b-a43d-45bd-873e-d29c37532a22" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-f9fbf46b-a43d-45bd-873e-d29c37532a22" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-5aa7657e-08e1-4b8a-9f6c-272f51b8d515" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-5aa7657e-08e1-4b8a-9f6c-272f51b8d515" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Deleting offline snapshot 5aa7657e-08e1-4b8a-9f6c-272f51b8d515 of volume f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] snapshot_file for this snap is: volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[468e16a3-c830-43bb-acc7-9a93f88b7f95]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:24 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 Feb 27 12:34:24 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:25 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515" returned: 0 in 0.637s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9fbf46b-a43d-45bd-873e-d29c37532a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:34:25 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4571b1-81dc-4649-b791-80710d0288fc]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:25 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 Feb 27 12:34:25 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:26 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22" returned: 0 in 0.686s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:26 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 Feb 27 12:34:26 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:26 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515" returned: 0 in 0.729s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:26 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515 Feb 27 12:34:26 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:27 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22.5aa7657e-08e1-4b8a-9f6c-272f51b8d515" returned: 0 in 0.624s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-5aa7657e-08e1-4b8a-9f6c-272f51b8d515" released by "_delete_snapshot" :: held 2.770s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (eb5108c3-6dba-427b-8a17-a4dfa1e23606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4471ca7-e268-4884-a183-a53058b43483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-f9fbf46b-a43d-45bd-873e-d29c37532a22" released by "delete_snapshot" :: held 2.813s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4471ca7-e268-4884-a183-a53058b43483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-378257969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41f3036-ce81-4a69-8c8f-902977c505ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:28Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e636eca-38e5-4ea1-ba5e-65d8612b222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e636eca-38e5-4ea1-ba5e-65d8612b222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d07ea25-30bc-45aa-84c0-c04d2d68764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d07ea25-30bc-45aa-84c0-c04d2d68764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41f3036-ce81-4a69-8c8f-902977c505ed', 'volume_name': 'volume-e41f3036-ce81-4a69-8c8f-902977c505ed', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf7be70-e6f1-4ef5-9833-739d74f1eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf7be70-e6f1-4ef5-9833-739d74f1eff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68c2d09-b8d4-490b-8b00-bc48b7463f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:27 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Volume e41f3036-ce81-4a69-8c8f-902977c505ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41f3036-ce81-4a69-8c8f-902977c505ed', 'volume_size': 1} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-378257969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41f3036-ce81-4a69-8c8f-902977c505ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:28Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Creating volume e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:27 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:27 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed 1073741824 Feb 27 12:34:27 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created reservations ['f2c9cfc3-c361-447f-b3ad-c0af8b27278e', '06c2a907-00bf-4cc1-9efa-155c85a04c47', 'c4aad5ba-96bd-4e57-bc43-aaa60f65bb6c', '82d3ffd1-18e6-42b9-942d-782bccb2e04f'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:27 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Delete snapshot completed successfully. Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-87ff6f19-91a4-44d7-9961-52b35bd3bfbc tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-5aa7657e-08e1-4b8a-9f6c-272f51b8d515-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-f9fbf46b-a43d-45bd-873e-d29c37532a22-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-f9fbf46b-a43d-45bd-873e-d29c37532a22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "cinder-quobyte-f9fbf46b-a43d-45bd-873e-d29c37532a22" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-f9fbf46b-a43d-45bd-873e-d29c37532a22" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ee187-6c94-446b-af95-60b0dfb73e49]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:28 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 Feb 27 12:34:28 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:28 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed 1073741824" returned: 0 in 0.913s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:28 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed Feb 27 12:34:28 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:28 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22" returned: 0 in 0.610s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:28 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22 Feb 27 12:34:28 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:29 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed" returned: 0 in 0.584s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68c2d09-b8d4-490b-8b00-bc48b7463f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41f3036-ce81-4a69-8c8f-902977c505ed', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468ccf76-2cca-425a-afc4-adb63a76a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:29 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Volume volume-e41f3036-ce81-4a69-8c8f-902977c505ed (e41f3036-ce81-4a69-8c8f-902977c505ed): created successfully Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468ccf76-2cca-425a-afc4-adb63a76a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (eb5108c3-6dba-427b-8a17-a4dfa1e23606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-986d0d79-cddf-429f-a44a-d50ffd86badb tempest-VolumesSnapshotTestJSON-841487923 None] Created volume successfully. Feb 27 12:34:29 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f9fbf46b-a43d-45bd-873e-d29c37532a22" returned: 0 in 0.600s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-quobyte-f9fbf46b-a43d-45bd-873e-d29c37532a22" released by "delete_volume" :: held 1.261s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Created reservations ['4a8c5bef-a3d4-4e1f-8c80-6d4c2bda9091', 'ff38f0f5-a1cf-4ce5-962c-d1d2c5ca5bb4', '93f4c4e2-9d6a-4a39-b7ab-67e3b3e8fa49', '33539c71-8751-43e2-865b-385679c200f7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:29 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:34:29 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Creating offline snapshot 70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf of volume e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feb2cad-0d59-49fc-9034-701a175c0162]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:29 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.482s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:34:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Deleted volume successfully. Feb 27 12:34:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-15d463cb-3f6b-4cac-a025-c079ebf84ec7 tempest-CreateVolumesFromSnapshotTest-1592197186 None] Lock "cinder-f9fbf46b-a43d-45bd-873e-d29c37532a22-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:30 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed Feb 27 12:34:30 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:30 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed" returned: 0 in 0.573s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:30 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf 1G Feb 27 12:34:30 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:31 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf 1G" returned: 0 in 0.584s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41f3036-ce81-4a69-8c8f-902977c505ed -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:31 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41f3036-ce81-4a69-8c8f-902977c505ed -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf Feb 27 12:34:31 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:31 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41f3036-ce81-4a69-8c8f-902977c505ed -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" returned: 0 in 0.521s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:31 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf is being set with open permissions: ugo+rw Feb 27 12:34:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:31 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf Feb 27 12:34:31 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:32 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" returned: 0 in 0.538s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:32 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.info Feb 27 12:34:32 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:32 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.info" returned: 0 in 0.529s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:32 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.info is being set with open permissions: ugo+rw Feb 27 12:34:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:32 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.info Feb 27 12:34:32 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:33 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.info" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.306s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:33 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-95085704-97a8-4123-9265-5961804afc23 tempest-VolumesSnapshotTestJSON-841487923 None] Create snapshot completed successfully Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-e41f3036-ce81-4a69-8c8f-902977c505ed" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-e41f3036-ce81-4a69-8c8f-902977c505ed" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Deleting offline snapshot 70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf of volume e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] snapshot_file for this snap is: volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bcee70-3be6-4610-85a0-3c85cb163caf]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:34 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf Feb 27 12:34:34 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:34 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" returned: 0 in 0.691s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41f3036-ce81-4a69-8c8f-902977c505ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:34:35 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcca003a-d86b-408f-93f6-5d0ccf512a7b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:35 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed Feb 27 12:34:35 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:35 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed" returned: 0 in 0.780s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:35 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf Feb 27 12:34:35 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:36 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" returned: 0 in 0.637s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:36 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf Feb 27 12:34:36 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f3c95465-0534-4bbd-83ac-ccba374ab4bd tempest-VolumesActionsTest-1915366989 None] Acquiring lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" by "attach_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f3c95465-0534-4bbd-83ac-ccba374ab4bd tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" acquired by "attach_volume" :: waited 0.027s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:37 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed.70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" returned: 0 in 0.671s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f3c95465-0534-4bbd-83ac-ccba374ab4bd tempest-VolumesActionsTest-1915366989 None] Attaching volume 6f84e8f2-f46e-4a01-a19e-bdd3ff12454b to instance ad5b83de-c648-4963-b508-d7d0a636409d at mountpoint /dev/vdb on host None. Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf" released by "_delete_snapshot" :: held 3.010s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f3c95465-0534-4bbd-83ac-ccba374ab4bd tempest-VolumesActionsTest-1915366989 None] Attach volume completed successfully. Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-e41f3036-ce81-4a69-8c8f-902977c505ed" released by "delete_snapshot" :: held 3.034s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f3c95465-0534-4bbd-83ac-ccba374ab4bd tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" released by "attach_volume" :: held 0.297s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['772f6b0f-fcbf-41d5-9c78-9223f5d733e8', 'c27031d4-617b-4f66-9dde-afae8ca5c80a', '08155d9c-78cc-41c7-ace9-6e27a7c6390f', 'c43f3b4e-47f5-493d-bac3-6d29b126420f'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:34:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Delete snapshot completed successfully. Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8bb3523a-061a-46b1-aa4b-ba13405a78ac tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-70f1fb31-70fd-4ee3-b6ab-a4f959e3dabf-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5ca0136c-909a-4c54-9205-4d6c2267cf62 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-detach_volume" by "detach_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5ca0136c-909a-4c54-9205-4d6c2267cf62 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:34:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5ca0136c-909a-4c54-9205-4d6c2267cf62 tempest-VolumesActionsTest-1915366989 None] Detaching volume 6f84e8f2-f46e-4a01-a19e-bdd3ff12454b from instance ad5b83de-c648-4963-b508-d7d0a636409d. Feb 27 12:34:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5ca0136c-909a-4c54-9205-4d6c2267cf62 tempest-VolumesActionsTest-1915366989 None] Detach volume completed successfully. Feb 27 12:34:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5ca0136c-909a-4c54-9205-4d6c2267cf62 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (ab47b6a2-c9ad-4ac5-b01d-76255afe3bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec29988-7004-4611-ab1f-ee53ba74fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec29988-7004-4611-ab1f-ee53ba74fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1907561550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bab328-bd57-4577-a788-6b93b0ed4a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:39Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd91ac2-0f48-434b-ac7d-7a369030a4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd91ac2-0f48-434b-ac7d-7a369030a4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e598568-8126-4db5-a65b-1f22aad9cb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e598568-8126-4db5-a65b-1f22aad9cb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bab328-bd57-4577-a788-6b93b0ed4a37', 'volume_name': 'volume-56bab328-bd57-4577-a788-6b93b0ed4a37', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ef2a7e-aa83-4dc1-a8de-8483681ff948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ef2a7e-aa83-4dc1-a8de-8483681ff948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48421a41-ad0d-4b48-abd6-0ad4fed8a760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:39 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Volume 56bab328-bd57-4577-a788-6b93b0ed4a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bab328-bd57-4577-a788-6b93b0ed4a37', 'volume_size': 1} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1907561550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bab328-bd57-4577-a788-6b93b0ed4a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:39Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Creating volume 56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:34:39 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:34:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:39 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 1073741824 Feb 27 12:34:39 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:41 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 1073741824" returned: 0 in 1.375s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:41 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 Feb 27 12:34:41 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:42 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37" returned: 0 in 1.140s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] <== create_volume: return (2611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:34:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.614s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48421a41-ad0d-4b48-abd6-0ad4fed8a760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bab328-bd57-4577-a788-6b93b0ed4a37', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34879a3f-8dbe-4da4-9e6d-a4bf0d715b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:42 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Volume volume-56bab328-bd57-4577-a788-6b93b0ed4a37 (56bab328-bd57-4577-a788-6b93b0ed4a37): created successfully Feb 27 12:34:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34879a3f-8dbe-4da4-9e6d-a4bf0d715b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:42 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (ab47b6a2-c9ad-4ac5-b01d-76255afe3bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-a70db502-ecd0-40a9-8fe3-4159084a77be tempest-VolumesSnapshotTestJSON-841487923 None] Created volume successfully. Feb 27 12:34:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Creating offline snapshot 1d714a30-8dc0-4450-891f-dcc5ac20fdd0 of volume 56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:34:43 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982bbb5-0914-4f2e-afd5-a91be1ae6ba6]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:43 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 Feb 27 12:34:43 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:44 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37" returned: 0 in 1.193s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:44 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 1G Feb 27 12:34:44 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:45 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 1G" returned: 0 in 1.106s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56bab328-bd57-4577-a788-6b93b0ed4a37 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:45 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56bab328-bd57-4577-a788-6b93b0ed4a37 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 Feb 27 12:34:45 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:46 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56bab328-bd57-4577-a788-6b93b0ed4a37 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0" returned: 0 in 0.572s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:46 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 is being set with open permissions: ugo+rw Feb 27 12:34:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:46 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 Feb 27 12:34:46 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:47 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0" returned: 0 in 1.206s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:47 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.info Feb 27 12:34:47 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:48 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.info" returned: 0 in 0.609s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:48 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.info is being set with open permissions: ugo+rw Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:48 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.info Feb 27 12:34:48 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:48 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.info" returned: 0 in 0.519s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.328s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.445s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c5e31-f1c4-4d11-9aa6-1fdcad0536e2]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:48 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-dc50cff3-42fc-4630-9781-70a08531dac1 tempest-VolumesSnapshotTestJSON-841487923 None] Create snapshot completed successfully Feb 27 12:34:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:48 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:34:48 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:49 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 0.691s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa1bc80-23a5-4cb4-b826-19e93f19fa7e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:49 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:34:49 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (bf507fda-bd9c-452e-ac6a-0c8ea1d9389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d37e51f-2dd7-48ce-b3be-aa1990721929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d37e51f-2dd7-48ce-b3be-aa1990721929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1552235783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc05bb8-5328-4324-a7b1-235dde004dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1d714a30-8dc0-4450-891f-dcc5ac20fdd0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:50Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa6684e-946b-427c-8dd4-a0299c5daf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa6684e-946b-427c-8dd4-a0299c5daf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d39cc2-91d9-4ee4-8799-b67131b75ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d39cc2-91d9-4ee4-8799-b67131b75ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afc05bb8-5328-4324-a7b1-235dde004dd4', 'volume_name': 'volume-afc05bb8-5328-4324-a7b1-235dde004dd4', 'volume_size': 2, 'snapshot_id': '1d714a30-8dc0-4450-891f-dcc5ac20fdd0'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b586cd7-9683-4a2e-8b46-adbdfd33ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b586cd7-9683-4a2e-8b46-adbdfd33ae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4301895b-f056-44b9-aa3f-42931e21b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:50 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Volume afc05bb8-5328-4324-a7b1-235dde004dd4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afc05bb8-5328-4324-a7b1-235dde004dd4', 'volume_size': 2, 'snapshot_id': '1d714a30-8dc0-4450-891f-dcc5ac20fdd0'} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:50 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 1.198s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.a9178096-9aaf-40d5-8a08-053dbaba2e6eiy_zutrn.img {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:50 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.a9178096-9aaf-40d5-8a08-053dbaba2e6eiy_zutrn.img Feb 27 12:34:50 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:55 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.a9178096-9aaf-40d5-8a08-053dbaba2e6eiy_zutrn.img" returned: 0 in 4.341s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:55 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4ca63a-fa5e-4f51-b1f7-8d0b3f52f8ac]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:34:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:34:55 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:34:55 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:34:56 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Feb 27 12:34:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 1.288s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:34:56 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.a9178096-9aaf-40d5-8a08-053dbaba2e6eiy_zutrn.img {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:34:56 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Converted 1024.00 MB image at 235.82 MB/s Feb 27 12:34:56 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=116,cinder:INSERT=38,cinder:UPDATE=151,cinder:DELETE=12 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:34:56 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=128,cinder:INSERT=34,cinder:UPDATE=133,cinder:DELETE=11 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:34:56 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] a9178096-9aaf-40d5-8a08-053dbaba2e6e was raw, no need to convert to raw {{(pid=83114) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 12:34:57 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Flow 'volume_create_manager' (43aa77b9-b42a-4d9d-97a6-1939de89c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeba676-714c-4bc9-bd8d-e9ae3f142fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeba676-714c-4bc9-bd8d-e9ae3f142fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1735395908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ddcb80-55b2-44d6-acc6-38961f8ea4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c864e0e5964590bd8b9de013045573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:58Z,use_quota=True,user_id='54290a7bdc314353bab222d8b7f1292e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481bffd3-c076-48e3-a40b-8bf4118884d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481bffd3-c076-48e3-a40b-8bf4118884d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd124710-4442-497c-a868-fcfaecb19c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd124710-4442-497c-a868-fcfaecb19c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ddcb80-55b2-44d6-acc6-38961f8ea4f0', 'volume_name': 'volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8423ac1a-2b93-4f6f-9142-ff84a055d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8423ac1a-2b93-4f6f-9142-ff84a055d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e550a71-54b0-40ed-990f-6480463e35ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:58 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Volume 81ddcb80-55b2-44d6-acc6-38961f8ea4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0', 'volume_size': 1} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Flow 'volume_create_manager' (f2c3a4be-76fc-4846-8255-76e0a36d8131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:34:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c884bb5b-1224-44ff-8ff3-baec304f958b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c884bb5b-1224-44ff-8ff3-baec304f958b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1822986845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02067180-6ad5-4d93-8116-240e8b33aa82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b46d4ede404364bd172861c719c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:59Z,use_quota=True,user_id='76a84b15f80b4848817e09776b3eafeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854d4a34-6059-402e-94a2-5d5aaffcc862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (854d4a34-6059-402e-94a2-5d5aaffcc862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7fb3e8-e541-4e82-bac5-f04a899eead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7fb3e8-e541-4e82-bac5-f04a899eead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02067180-6ad5-4d93-8116-240e8b33aa82', 'volume_name': 'volume-02067180-6ad5-4d93-8116-240e8b33aa82', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a6c655-98c3-4a54-a10b-ef0266ac3097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a6c655-98c3-4a54-a10b-ef0266ac3097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170ffb2a-c0f7-40df-ad79-d5e2cc99dbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:34:59 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Volume 02067180-6ad5-4d93-8116-240e8b33aa82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02067180-6ad5-4d93-8116-240e8b33aa82', 'volume_size': 1} Feb 27 12:34:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:07 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:07 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:07 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.614s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:07 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.722s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Uploaded volume to glance image-id: a9178096-9aaf-40d5-8a08-053dbaba2e6e. {{(pid=83114) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.894s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-1d714a30-8dc0-4450-891f-dcc5ac20fdd0-afc05bb8-5328-4324-a7b1-235dde004dd4" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-1d714a30-8dc0-4450-891f-dcc5ac20fdd0-afc05bb8-5328-4324-a7b1-235dde004dd4" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Creating volume afc05bb8-5328-4324-a7b1-235dde004dd4 from snapshot 1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-afc05bb8-5328-4324-a7b1-235dde004dd4" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-42ed1416-4190-4d72-8c47-be292c1e7b96 tempest-VolumesActionsTest-1915366989 None] Copy volume to image completed successfully. Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-afc05bb8-5328-4324-a7b1-235dde004dd4" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] snapshot: 1d714a30-8dc0-4450-891f-dcc5ac20fdd0, volume: afc05bb8-5328-4324-a7b1-235dde004dd4, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[6756c7b1-275a-496e-a82b-0158c0a0b7fa]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:09 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 Feb 27 12:35:09 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:10 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56bab328-bd57-4577-a788-6b93b0ed4a37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b51cc-c500-43f3-ac5a-dd5d551ba8ed]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:10 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 Feb 27 12:35:10 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:10 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37" returned: 0 in 0.573s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:35:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:10 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 Feb 27 12:35:10 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:13 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4" returned: 0 in 3.204s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53b7059-a352-40ef-b47b-9ef18c256537]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:14 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 Feb 27 12:35:14 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:14 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37" returned: 0 in 0.686s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:14 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37, size 1024.00 MB, duration 3.20 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:14 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Converted 1024.00 MB image at 319.51 MB/s Feb 27 12:35:14 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 is being set with open permissions: ugo+rw Feb 27 12:35:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:14 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 Feb 27 12:35:14 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:15 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4" returned: 0 in 0.440s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-afc05bb8-5328-4324-a7b1-235dde004dd4" released by "_copy_volume_from_snapshot" :: held 5.512s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-1d714a30-8dc0-4450-891f-dcc5ac20fdd0-afc05bb8-5328-4324-a7b1-235dde004dd4" released by "_create_volume_from_snapshot" :: held 5.534s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.551s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.024s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1735395908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ddcb80-55b2-44d6-acc6-38961f8ea4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c864e0e5964590bd8b9de013045573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:58Z,use_quota=True,user_id='54290a7bdc314353bab222d8b7f1292e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Creating volume 81ddcb80-55b2-44d6-acc6-38961f8ea4f0 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:15 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:15 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 1073741824 Feb 27 12:35:15 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4301895b-f056-44b9-aa3f-42931e21b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc05bb8-5328-4324-a7b1-235dde004dd4', 'volume_size': 2, 'snapshot_id': '1d714a30-8dc0-4450-891f-dcc5ac20fdd0'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e91a57-de48-47c6-88a5-0e92013c2b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:15 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Volume volume-afc05bb8-5328-4324-a7b1-235dde004dd4 (afc05bb8-5328-4324-a7b1-235dde004dd4): created successfully Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e91a57-de48-47c6-88a5-0e92013c2b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (bf507fda-bd9c-452e-ac6a-0c8ea1d9389b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:15 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-55e3f00b-df53-429b-8e74-19509e9d11f2 tempest-VolumesSnapshotTestJSON-841487923 None] Created volume successfully. Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-afc05bb8-5328-4324-a7b1-235dde004dd4-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-afc05bb8-5328-4324-a7b1-235dde004dd4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-afc05bb8-5328-4324-a7b1-235dde004dd4" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-afc05bb8-5328-4324-a7b1-235dde004dd4" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f7066-2722-40c3-be09-98b8a4c6f738]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:15 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 Feb 27 12:35:15 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:15 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 1073741824" returned: 0 in 0.562s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:15 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 Feb 27 12:35:15 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:15 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4" returned: 0 in 0.504s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:15 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4 Feb 27 12:35:15 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:16 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0" returned: 0 in 0.449s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.071s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1822986845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02067180-6ad5-4d93-8116-240e8b33aa82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b46d4ede404364bd172861c719c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:34:59Z,use_quota=True,user_id='76a84b15f80b4848817e09776b3eafeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Creating volume 02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:16 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e550a71-54b0-40ed-990f-6480463e35ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd9a27-b4d8-4f16-b00a-1747a15d04c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:16 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 1073741824 Feb 27 12:35:16 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:16 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Volume volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 (81ddcb80-55b2-44d6-acc6-38961f8ea4f0): created successfully Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd9a27-b4d8-4f16-b00a-1747a15d04c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Flow 'volume_create_manager' (43aa77b9-b42a-4d9d-97a6-1939de89c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:16 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-877041af-21b2-4c52-bdee-edbc0a48d146 tempest-ServerRescueNegativeTestJSON-2109456048 None] Created volume successfully. Feb 27 12:35:16 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-afc05bb8-5328-4324-a7b1-235dde004dd4" returned: 0 in 0.470s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-afc05bb8-5328-4324-a7b1-235dde004dd4" released by "delete_volume" :: held 1.026s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['be8e3fa3-8c6b-403d-a4bb-da229a25a7a1', '5f1cab25-bc7e-41ac-a9d9-900cd9f8c852', '2933a6f4-9a23-4873-b024-85991244b595', 'd7dde557-4819-45bc-ab47-bebb2588023c'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:16 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:16 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:16 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 1073741824" returned: 0 in 0.585s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:16 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 Feb 27 12:35:16 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:17 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.533s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:17 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Deleted volume successfully. Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-bf3f3bd1-1d21-4fd5-b930-cbf39e8f6d71 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-afc05bb8-5328-4324-a7b1-235dde004dd4-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:17 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82" returned: 0 in 0.481s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.024s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170ffb2a-c0f7-40df-ad79-d5e2cc99dbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02067180-6ad5-4d93-8116-240e8b33aa82', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8dfee8-4f3e-40dd-be4a-73ed37ee5a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f409a5e-dffc-473f-a47b-6b062408ca1f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:17 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Volume volume-02067180-6ad5-4d93-8116-240e8b33aa82 (02067180-6ad5-4d93-8116-240e8b33aa82): created successfully Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8dfee8-4f3e-40dd-be4a-73ed37ee5a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Flow 'volume_create_manager' (f2c3a4be-76fc-4846-8255-76e0a36d8131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:17 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-723ce6a9-c7b6-40b0-99af-9aededf0b10e tempest-SnapshotDependencyTests-1791855174 None] Created volume successfully. Feb 27 12:35:17 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:35:17 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-1d714a30-8dc0-4450-891f-dcc5ac20fdd0-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-1d714a30-8dc0-4450-891f-dcc5ac20fdd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-56bab328-bd57-4577-a788-6b93b0ed4a37" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-56bab328-bd57-4577-a788-6b93b0ed4a37" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-1d714a30-8dc0-4450-891f-dcc5ac20fdd0" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-1d714a30-8dc0-4450-891f-dcc5ac20fdd0" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Deleting offline snapshot 1d714a30-8dc0-4450-891f-dcc5ac20fdd0 of volume 56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] snapshot_file for this snap is: volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa254fa-2ff3-4083-ab63-6c9c464cb5ef]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:17 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 Feb 27 12:35:17 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:17 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 0.639s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d57128e-e208-4783-9634-e3d8a54d555e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:17 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:35:17 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:18 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0" returned: 0 in 0.556s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56bab328-bd57-4577-a788-6b93b0ed4a37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b972a4-7687-4e5d-80f7-9470c360d36f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:18 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 Feb 27 12:35:18 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:18 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 0.591s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:18 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img Feb 27 12:35:18 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:18 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37" returned: 0 in 0.683s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:19 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 Feb 27 12:35:19 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:20 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0" returned: 0 in 1.980s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:21 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0 Feb 27 12:35:21 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:22 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37.1d714a30-8dc0-4450-891f-dcc5ac20fdd0" returned: 0 in 1.305s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:22 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img" returned: 0 in 3.809s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-1d714a30-8dc0-4450-891f-dcc5ac20fdd0" released by "_delete_snapshot" :: held 4.615s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-56bab328-bd57-4577-a788-6b93b0ed4a37" released by "delete_snapshot" :: held 4.659s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ce6fa5-32b9-4e02-a885-6526e49c3579]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['a02a174f-ee2c-42ea-b5a4-598d18888a1f', 'dde5901c-2d3d-4d4a-98a3-07d3651513ce', 'facbf47b-a46a-4e7f-aad9-0c100bfa6526', '9c534cca-d539-4e7c-844e-834cbf59e5b6'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:22 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Delete snapshot completed successfully. Feb 27 12:35:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6dbc04d0-e411-48e4-9323-826d42f04763 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-1d714a30-8dc0-4450-891f-dcc5ac20fdd0-delete_snapshot" released by "delete_snapshot" :: held 4.796s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:22 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:35:22 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:23 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 0.747s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b, size 1024.00 MB, duration 3.81 sec, destination /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:23 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Converted 1024.00 MB image at 268.76 MB/s Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] 71cb557b-151f-4926-99bc-1f3e57b28cdb was raw, converting to qcow2 {{(pid=83114) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad512e5d-ffaf-4142-8e74-27a38a0d2d4f]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:23 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img Feb 27 12:35:23 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-56bab328-bd57-4577-a788-6b93b0ed4a37-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-56bab328-bd57-4577-a788-6b93b0ed4a37-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-56bab328-bd57-4577-a788-6b93b0ed4a37" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-56bab328-bd57-4577-a788-6b93b0ed4a37" acquired by "delete_volume" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd78c34-5a61-4ed6-8330-30d7a3d15610]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:23 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 Feb 27 12:35:23 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:23 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img" returned: 0 in 0.607s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:23 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img Feb 27 12:35:23 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:23 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37" returned: 0 in 0.524s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:23 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37 Feb 27 12:35:23 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:24 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img" returned: 1 in 0.465s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img /opt/stack/data/cinder/conversion/vol_upload_qg8nbdr9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:24 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img /opt/stack/data/cinder/conversion/vol_upload_qg8nbdr9 Feb 27 12:35:24 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:24 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-56bab328-bd57-4577-a788-6b93b0ed4a37" returned: 0 in 0.406s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-56bab328-bd57-4577-a788-6b93b0ed4a37" released by "delete_volume" :: held 0.984s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['b426d9d6-a032-473f-b83d-1d41ef797738', '9f390996-ae56-4911-8434-7a16b40c71b8', 'afba7698-8bf9-4184-b559-12099a6b6f77', 'b0e7ae8a-59e7-4053-9f02-6702456e0f45'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:24 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:24 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:24 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img /opt/stack/data/cinder/conversion/vol_upload_qg8nbdr9" returned: 0 in 0.499s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Image conversion details: src /opt/stack/data/cinder/conversion/6f84e8f2-f46e-4a01-a19e-bdd3ff12454b.temp_image.71cb557b-151f-4926-99bc-1f3e57b28cdbgacebvva.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qg8nbdr9 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:24 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[852229e8-2051-4881-8e84-a72b7efd69ad]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qg8nbdr9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:24 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qg8nbdr9 Feb 27 12:35:24 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:24 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (9f61ac24-29ae-4193-b127-a15c234743b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951d443c-1863-4d90-82ec-8bfb3d4818eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:25 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951d443c-1863-4d90-82ec-8bfb3d4818eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377368010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e23a55-b8c5-44ee-9d99-276411277dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:25Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bce0f6-13a2-448e-be30-8bffd5aac7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bce0f6-13a2-448e-be30-8bffd5aac7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbf1b13-258a-4307-b0c0-71365572f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbf1b13-258a-4307-b0c0-71365572f049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e23a55-b8c5-44ee-9d99-276411277dcc', 'volume_name': 'volume-c1e23a55-b8c5-44ee-9d99-276411277dcc', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ba1eea-1b03-4208-831f-2ee7a9d8c9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ba1eea-1b03-4208-831f-2ee7a9d8c9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712a01f1-9673-4fb8-a64e-b5881aab1ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:25 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Volume c1e23a55-b8c5-44ee-9d99-276411277dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e23a55-b8c5-44ee-9d99-276411277dcc', 'volume_size': 1} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.621s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:25 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Deleted volume successfully. Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-deec507c-30d8-4729-8ee8-871e74f8a8df tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-56bab328-bd57-4577-a788-6b93b0ed4a37-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:25 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qg8nbdr9" returned: 0 in 0.632s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.219s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Uploaded volume to glance image-id: 71cb557b-151f-4926-99bc-1f3e57b28cdb. {{(pid=83114) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 12:35:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.758s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:26 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f9b3bc10-780a-4b16-91fe-5024025a1823 tempest-VolumesActionsTest-1915366989 None] Copy volume to image completed successfully. Feb 27 12:35:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Creating offline snapshot 72f68421-7794-4cdf-a013-c31ff4391b6d of volume 02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:35:26 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[de808482-c773-4a4e-8d67-78c56c940c11]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:26 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 Feb 27 12:35:26 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:27 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82" returned: 0 in 1.121s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:27 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d 1G Feb 27 12:35:27 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "cinder-quobyte-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-quobyte-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd4e1c-cd03-4676-9dd6-c5713a239c22]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:28 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:35:28 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:28 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d 1G" returned: 0 in 0.816s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02067180-6ad5-4d93-8116-240e8b33aa82 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:28 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02067180-6ad5-4d93-8116-240e8b33aa82 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d Feb 27 12:35:28 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:28 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 0.664s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:28 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b Feb 27 12:35:28 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:29 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02067180-6ad5-4d93-8116-240e8b33aa82 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d" returned: 0 in 0.714s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:29 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d is being set with open permissions: ugo+rw Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:29 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d Feb 27 12:35:29 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:29 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" returned: 0 in 0.868s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-quobyte-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b" released by "delete_volume" :: held 1.570s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Created reservations ['e6439ab9-efd7-4e1e-ad11-2b9947c25510', 'e12238bd-d22d-49c1-9b2d-6124e33f0294', 'b87bf41e-dda3-4036-8ae7-24202b0f6260', '41de0c4b-76dc-4b2a-b565-c13c2de92d10'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:29 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d" returned: 0 in 0.550s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:29 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:29 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:29 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.info Feb 27 12:35:29 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:30 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.441s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Deleted volume successfully. Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2c89c552-5336-4fa4-91a2-b324afa9d493 tempest-VolumesActionsTest-1915366989 None] Lock "cinder-6f84e8f2-f46e-4a01-a19e-bdd3ff12454b-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:30 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.info" returned: 0 in 0.470s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:30 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.info is being set with open permissions: ugo+rw Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:30 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.info Feb 27 12:35:30 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:30 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.info" returned: 0 in 0.508s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.305s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.720s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377368010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e23a55-b8c5-44ee-9d99-276411277dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:25Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Creating volume c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:30 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:35:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:30 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc 1073741824 Feb 27 12:35:30 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-316690c7-e3f6-48c1-92f7-97c01f26d8d8 tempest-SnapshotDependencyTests-1791855174 None] Create snapshot completed successfully Feb 27 12:35:31 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc 1073741824" returned: 0 in 0.619s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:31 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc Feb 27 12:35:31 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Flow 'volume_create_manager' (f46b3c05-f788-442f-9ed2-b720c837d538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6787274-d0ec-4098-a4aa-8f519e389622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6787274-d0ec-4098-a4aa-8f519e389622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4636fb67-6789-40a2-9aa9-a9d1c868fb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b46d4ede404364bd172861c719c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72f68421-7794-4cdf-a013-c31ff4391b6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:32Z,use_quota=True,user_id='76a84b15f80b4848817e09776b3eafeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53212e44-d138-4736-886a-798bf5dfe6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53212e44-d138-4736-886a-798bf5dfe6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205fa2b5-0f68-4acb-99da-44d616f99112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205fa2b5-0f68-4acb-99da-44d616f99112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4636fb67-6789-40a2-9aa9-a9d1c868fb24', 'volume_name': 'volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24', 'volume_size': 1, 'snapshot_id': '72f68421-7794-4cdf-a013-c31ff4391b6d'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4df0ab-8b72-419b-80d6-9fd0499fe0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4df0ab-8b72-419b-80d6-9fd0499fe0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:32 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdaad31-d63e-40e7-82fd-3be12c748058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:32 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Volume 4636fb67-6789-40a2-9aa9-a9d1c868fb24: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24', 'volume_size': 1, 'snapshot_id': '72f68421-7794-4cdf-a013-c31ff4391b6d'} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc" returned: 0 in 0.909s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-quobyte-72f68421-7794-4cdf-a013-c31ff4391b6d-4636fb67-6789-40a2-9aa9-a9d1c868fb24" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712a01f1-9673-4fb8-a64e-b5881aab1ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e23a55-b8c5-44ee-9d99-276411277dcc', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d05a83c-e1ee-431a-839f-bd698b3154cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-72f68421-7794-4cdf-a013-c31ff4391b6d-4636fb67-6789-40a2-9aa9-a9d1c868fb24" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Creating volume 4636fb67-6789-40a2-9aa9-a9d1c868fb24 from snapshot 72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-quobyte-4636fb67-6789-40a2-9aa9-a9d1c868fb24" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:32 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Volume volume-c1e23a55-b8c5-44ee-9d99-276411277dcc (c1e23a55-b8c5-44ee-9d99-276411277dcc): created successfully Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d05a83c-e1ee-431a-839f-bd698b3154cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (9f61ac24-29ae-4193-b127-a15c234743b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-4636fb67-6789-40a2-9aa9-a9d1c868fb24" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] snapshot: 72f68421-7794-4cdf-a013-c31ff4391b6d, volume: 4636fb67-6789-40a2-9aa9-a9d1c868fb24, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:35:32 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9e04cce4-f45d-4d83-a01a-8d4f28b59fe5 tempest-VolumesSnapshotTestJSON-841487923 None] Created volume successfully. Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd96284-a1f7-48ff-8795-d7da2726e16e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:32 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d Feb 27 12:35:32 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:33 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d" returned: 0 in 0.791s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02067180-6ad5-4d93-8116-240e8b33aa82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b8d47d-77c0-4b1a-81c7-db3a7945b1f5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:33 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 Feb 27 12:35:33 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Acquiring lock "cinder-81ddcb80-55b2-44d6-acc6-38961f8ea4f0-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "cinder-81ddcb80-55b2-44d6-acc6-38961f8ea4f0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Acquiring lock "cinder-quobyte-81ddcb80-55b2-44d6-acc6-38961f8ea4f0" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "cinder-quobyte-81ddcb80-55b2-44d6-acc6-38961f8ea4f0" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11c0c13-d049-47b7-b01d-8597babd57e1]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:34 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 Feb 27 12:35:34 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:34 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82" returned: 0 in 0.839s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:34 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:35:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:34 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 Feb 27 12:35:34 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:34 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0" returned: 0 in 0.608s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:34 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0 Feb 27 12:35:34 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:35 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-81ddcb80-55b2-44d6-acc6-38961f8ea4f0" returned: 0 in 1.225s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "cinder-quobyte-81ddcb80-55b2-44d6-acc6-38961f8ea4f0" released by "delete_volume" :: held 1.875s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:35 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Created reservations ['412ee321-b5c8-4126-a1e0-be4ecf650ab2', '9bf25b7a-463b-4d53-86d3-5ce4b64f3c81', 'cf89635e-c006-4fbd-a002-19a58c99c445', '3b636780-829c-4f5a-b21d-34076a007bae'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:36 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:36 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:37 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24" returned: 0 in 3.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:37 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f71839-f2ab-4565-b5b2-7e5a6bb0aaae]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:37 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 Feb 27 12:35:37 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:37 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 1.868s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:37 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:38 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Deleted volume successfully. Feb 27 12:35:38 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a3224020-7a7a-4d21-ba47-6cb0eed3fe0f tempest-ServerRescueNegativeTestJSON-2109456048 None] Lock "cinder-81ddcb80-55b2-44d6-acc6-38961f8ea4f0-delete_volume" released by "delete_volume" :: held 4.228s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:38 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82" returned: 0 in 0.946s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:38 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82, size 1024.00 MB, duration 3.56 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:38 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Converted 1024.00 MB image at 287.78 MB/s Feb 27 12:35:38 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 is being set with open permissions: ugo+rw Feb 27 12:35:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:38 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 Feb 27 12:35:38 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:39 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24" returned: 0 in 0.538s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-4636fb67-6789-40a2-9aa9-a9d1c868fb24" released by "_copy_volume_from_snapshot" :: held 6.794s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-72f68421-7794-4cdf-a013-c31ff4391b6d-4636fb67-6789-40a2-9aa9-a9d1c868fb24" released by "_create_volume_from_snapshot" :: held 6.835s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.870s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.103s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Creating offline snapshot f60822e6-27a9-4221-96b9-6ddcd1b8b248 of volume c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90aa61-de71-4d0d-a0ae-80a7f301cb61]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdaad31-d63e-40e7-82fd-3be12c748058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24', 'volume_size': 1, 'snapshot_id': '72f68421-7794-4cdf-a013-c31ff4391b6d'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01da69c9-6609-46e2-85f3-3aeab52289d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:39 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Volume volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 (4636fb67-6789-40a2-9aa9-a9d1c868fb24): created successfully Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01da69c9-6609-46e2-85f3-3aeab52289d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Flow 'volume_create_manager' (f46b3c05-f788-442f-9ed2-b720c837d538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:39 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc Feb 27 12:35:39 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:39 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-48963226-3933-4538-b7aa-b5f52d41f58a tempest-SnapshotDependencyTests-1791855174 None] Created volume successfully. Feb 27 12:35:39 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc" returned: 0 in 0.588s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:39 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 1G Feb 27 12:35:39 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-72f68421-7794-4cdf-a013-c31ff4391b6d-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-72f68421-7794-4cdf-a013-c31ff4391b6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-quobyte-02067180-6ad5-4d93-8116-240e8b33aa82" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-02067180-6ad5-4d93-8116-240e8b33aa82" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-quobyte-72f68421-7794-4cdf-a013-c31ff4391b6d" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-72f68421-7794-4cdf-a013-c31ff4391b6d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Deleting offline snapshot 72f68421-7794-4cdf-a013-c31ff4391b6d of volume 02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] snapshot_file for this snap is: volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e85d1e-d475-468f-aaac-8904e733582a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:40 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d Feb 27 12:35:40 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:40 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 1G" returned: 0 in 0.831s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e23a55-b8c5-44ee-9d99-276411277dcc -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:40 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e23a55-b8c5-44ee-9d99-276411277dcc -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 Feb 27 12:35:40 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Flow 'volume_create_manager' (f5f1842c-24e5-4411-abfa-137cdb0c92e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd6e163-e8d7-4542-9312-19a7ca1c47f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd6e163-e8d7-4542-9312-19a7ca1c47f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1922869620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6764a620-2c07-41b7-826e-91d278101a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2ce12ef57b44c5aa61596ef432ae19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:41Z,use_quota=True,user_id='e4b8a6746b0f4559a158d915faa86ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70d7707-de64-435c-8c70-2dece58dc74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70d7707-de64-435c-8c70-2dece58dc74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f386e572-8459-4ca7-8da1-c4195e57b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:40 devstack cinder-volume[83114]: DEBUG cinder.image.glance [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Creating Keystone auth plugin from conf {{(pid=83114) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f386e572-8459-4ca7-8da1-c4195e57b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6764a620-2c07-41b7-826e-91d278101a37', 'volume_name': 'volume-6764a620-2c07-41b7-826e-91d278101a37', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa93be45-0dda-4c05-b78f-27266e7ad175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa93be45-0dda-4c05-b78f-27266e7ad175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b9e545-f719-4b2b-90c1-248b5bf28932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:41 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Volume 6764a620-2c07-41b7-826e-91d278101a37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6764a620-2c07-41b7-826e-91d278101a37', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Trying to clone 6764a620-2c07-41b7-826e-91d278101a37 from image 449413c1-523c-4e99-abe8-e0bfc981c2bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]). {{(pid=83114) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:35:41 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e23a55-b8c5-44ee-9d99-276411277dcc -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248" returned: 0 in 0.670s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:41 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 is being set with open permissions: ugo+rw Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:41 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 Feb 27 12:35:41 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:41 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d" returned: 0 in 0.998s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02067180-6ad5-4d93-8116-240e8b33aa82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e3c83-a12a-40b0-96e4-c085ae8c8d1b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:35:41 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:35:41 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 Feb 27 12:35:41 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[892e990c-a02b-43f2-bd14-795e1c153775]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:41 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD Feb 27 12:35:41 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:41 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248" returned: 0 in 0.491s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:41 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.info Feb 27 12:35:41 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82" returned: 0 in 0.573s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d Feb 27 12:35:42 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc is fetched for user e4b8a6746b0f4559a158d915faa86ae5. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[466ca992-90d2-433a-9f06-604bbf50f227]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD Feb 27 12:35:42 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.info" returned: 0 in 0.458s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.info is being set with open permissions: ugo+rw Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.info Feb 27 12:35:42 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d" returned: 0 in 0.565s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d Feb 27 12:35:42 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:42 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:42 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.info" returned: 0 in 0.586s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.713s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1922869620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6764a620-2c07-41b7-826e-91d278101a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2ce12ef57b44c5aa61596ef432ae19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:41Z,use_quota=True,user_id='e4b8a6746b0f4559a158d915faa86ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Creating volume 6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:42 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:35:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:42 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 1073741824 Feb 27 12:35:42 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6358fcb1-868d-41e6-8ccf-a679cdb4a3b8 tempest-VolumesSnapshotTestJSON-841487923 None] Create snapshot completed successfully Feb 27 12:35:43 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82.72f68421-7794-4cdf-a013-c31ff4391b6d" returned: 0 in 0.473s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-72f68421-7794-4cdf-a013-c31ff4391b6d" released by "_delete_snapshot" :: held 2.692s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-02067180-6ad5-4d93-8116-240e8b33aa82" released by "delete_snapshot" :: held 2.723s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Created reservations ['b8d215f2-a9df-4b36-be30-735b36eee414', 'adb642f6-6b70-4496-9e6a-24e82d88095d', 'a3ded391-6919-48e7-9bbd-2f61842b3f18', '048b2108-abe2-462a-9e22-268a83414549'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Delete snapshot completed successfully. Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2938e1e0-60b2-4b42-a00a-a4d0adc28d30 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-72f68421-7794-4cdf-a013-c31ff4391b6d-delete_snapshot" released by "delete_snapshot" :: held 2.837s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:43 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 1073741824" returned: 0 in 0.520s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:43 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:43 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-02067180-6ad5-4d93-8116-240e8b33aa82-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-02067180-6ad5-4d93-8116-240e8b33aa82-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-quobyte-02067180-6ad5-4d93-8116-240e8b33aa82" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-02067180-6ad5-4d93-8116-240e8b33aa82" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[303844a9-49aa-42a2-aa3b-83673e0b4cc6]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:43 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 Feb 27 12:35:43 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (4933bdfb-cb32-48c6-a0d6-a0c9557d06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce9b215-eb21-4a38-b255-58f14a101ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce9b215-eb21-4a38-b255-58f14a101ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1325981584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051360a5-7731-4c3f-99ea-9c4ad3c36833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49031600cdf44373b518b065f210d226',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f60822e6-27a9-4221-96b9-6ddcd1b8b248,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:44Z,use_quota=True,user_id='2ffe0b1670264a09809c4b9691ab8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55838e3-b2c1-44e5-af81-a1aed79da861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55838e3-b2c1-44e5-af81-a1aed79da861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9b8625-f470-40b1-a556-deadd1c1d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9b8625-f470-40b1-a556-deadd1c1d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '051360a5-7731-4c3f-99ea-9c4ad3c36833', 'volume_name': 'volume-051360a5-7731-4c3f-99ea-9c4ad3c36833', 'volume_size': 1, 'snapshot_id': 'f60822e6-27a9-4221-96b9-6ddcd1b8b248'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42885f2a-66ba-4bbb-a650-4221f134539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42885f2a-66ba-4bbb-a650-4221f134539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e315d-57be-466f-a0f9-cdee8633c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:44 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Volume 051360a5-7731-4c3f-99ea-9c4ad3c36833: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-051360a5-7731-4c3f-99ea-9c4ad3c36833', 'volume_size': 1, 'snapshot_id': 'f60822e6-27a9-4221-96b9-6ddcd1b8b248'} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:44 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 0 in 0.737s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.021s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-f60822e6-27a9-4221-96b9-6ddcd1b8b248-051360a5-7731-4c3f-99ea-9c4ad3c36833" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Attempting download of 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume 6764a620-2c07-41b7-826e-91d278101a37. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-f60822e6-27a9-4221-96b9-6ddcd1b8b248-051360a5-7731-4c3f-99ea-9c4ad3c36833" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Creating volume 051360a5-7731-4c3f-99ea-9c4ad3c36833 from snapshot f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-051360a5-7731-4c3f-99ea-9c4ad3c36833" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-051360a5-7731-4c3f-99ea-9c4ad3c36833" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] snapshot: f60822e6-27a9-4221-96b9-6ddcd1b8b248, volume: 051360a5-7731-4c3f-99ea-9c4ad3c36833, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1365ea85-7f8a-46d8-b979-e41d4709b4e4]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f781ca-840f-447a-a1b7-a01fbcd45804]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_j9plev2u {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:44 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82" returned: 0 in 0.655s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:44 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 Feb 27 12:35:44 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:44 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82 Feb 27 12:35:44 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:44 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_j9plev2u Feb 27 12:35:44 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:44 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248" returned: 0 in 0.484s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1e23a55-b8c5-44ee-9d99-276411277dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[08887faa-8b23-44d6-8c46-c43d43fd19d8]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:44 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_j9plev2u" returned: 0 in 0.520s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_j9plev2u {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:44 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02067180-6ad5-4d93-8116-240e8b33aa82" returned: 0 in 0.505s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-02067180-6ad5-4d93-8116-240e8b33aa82" released by "delete_volume" :: held 1.208s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:44 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc Feb 27 12:35:44 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Created reservations ['9dc9dffe-6dd9-4b33-a9dd-41e45774f173', '2bdb9a12-9e2e-46f7-a12a-5564c880008d', '83875894-6570-4826-9ebd-7782a087ea81', 'e883db04-9fd8-4972-bec5-39c65b63ea79'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:44 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_j9plev2u Feb 27 12:35:44 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:45 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:45 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:45 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc" returned: 0 in 0.757s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:45 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 Feb 27 12:35:45 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:45 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_j9plev2u" returned: 1 in 0.771s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_j9plev2u' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af1cd56-74c8-4ee9-81c8-51e11e1d3ffe]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:45 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.674s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:45 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Deleted volume successfully. Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-fe5abaf9-4b83-4788-be61-d7fc6c85c7f8 tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-02067180-6ad5-4d93-8116-240e8b33aa82-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:45 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD Feb 27 12:35:45 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-4636fb67-6789-40a2-9aa9-a9d1c868fb24-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-4636fb67-6789-40a2-9aa9-a9d1c868fb24-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "cinder-quobyte-4636fb67-6789-40a2-9aa9-a9d1c868fb24" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-4636fb67-6789-40a2-9aa9-a9d1c868fb24" acquired by "delete_volume" :: waited 0.023s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba1efda-eb8a-4d7a-8dd1-fed71b3459b4]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:46 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 Feb 27 12:35:46 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:46 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD" returned: 0 in 1.350s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:46 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] 449413c1-523c-4e99-abe8-e0bfc981c2bc was qcow2, converting to raw {{(pid=83114) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:35:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:47 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:47 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:47 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24" returned: 0 in 1.415s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:47 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24 Feb 27 12:35:47 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:48 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833" returned: 0 in 2.807s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043fc99-4e92-4cda-a9ba-83a260b52225]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:48 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4636fb67-6789-40a2-9aa9-a9d1c868fb24" returned: 0 in 1.069s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-quobyte-4636fb67-6789-40a2-9aa9-a9d1c868fb24" released by "delete_volume" :: held 2.508s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Created reservations ['a6528455-9b34-49d7-9f6c-66cc4468485a', '0a401af6-ea34-451c-af3d-0b404730835c', 'd38ecab2-2deb-4883-b8b4-80805937cbe5', '9a179b66-0a08-4ee3-9c7e-ed7c21b2ed5f'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:48 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc Feb 27 12:35:48 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:48 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:48 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:48 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 0 in 1.969s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_3etewl8hdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:48 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Converted 112.00 MB image at 56.85 MB/s Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:48 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 1G Feb 27 12:35:48 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:48 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.475s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:48 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:48 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Deleted volume successfully. Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cf71c09-951c-41a6-b59a-b2cee2c2bebc tempest-SnapshotDependencyTests-1791855174 None] Lock "cinder-4636fb67-6789-40a2-9aa9-a9d1c868fb24-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:49 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc" returned: 0 in 0.708s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:35:49 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Converted 1024.00 MB image at 364.53 MB/s Feb 27 12:35:49 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 is being set with open permissions: ugo+rw Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:49 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 Feb 27 12:35:49 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:49 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 1G" returned: 0 in 0.545s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[948dca87-897e-4461-8b1e-2491aab1300e]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:49 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:49 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:49 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833" returned: 0 in 0.539s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-051360a5-7731-4c3f-99ea-9c4ad3c36833" released by "_copy_volume_from_snapshot" :: held 5.360s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-f60822e6-27a9-4221-96b9-6ddcd1b8b248-051360a5-7731-4c3f-99ea-9c4ad3c36833" released by "_create_volume_from_snapshot" :: held 5.376s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.405s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e315d-57be-466f-a0f9-cdee8633c738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051360a5-7731-4c3f-99ea-9c4ad3c36833', 'volume_size': 1, 'snapshot_id': 'f60822e6-27a9-4221-96b9-6ddcd1b8b248'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baddd68e-a471-4b13-9fc4-2d605d19a4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:49 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Volume volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 (051360a5-7731-4c3f-99ea-9c4ad3c36833): created successfully Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baddd68e-a471-4b13-9fc4-2d605d19a4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Flow 'volume_create_manager' (4933bdfb-cb32-48c6-a0d6-a0c9557d06b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:49 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ffaf7dde-326d-4a61-9622-2216e16d1a4e tempest-VolumesSnapshotTestJSON-841487923 None] Created volume successfully. Feb 27 12:35:50 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 0 in 0.565s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:50 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:50 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:50 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 1 in 0.583s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Downloaded image 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume 6764a620-2c07-41b7-826e-91d278101a37 successfully. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc for user e4b8a6746b0f4559a158d915faa86ae5 is deleted. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Marking volume 6764a620-2c07-41b7-826e-91d278101a37 as bootable. {{(pid=83114) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Copying metadata from image 449413c1-523c-4e99-abe8-e0bfc981c2bc to 6764a620-2c07-41b7-826e-91d278101a37. {{(pid=83114) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Creating volume glance metadata for volume 6764a620-2c07-41b7-826e-91d278101a37 backed by image 449413c1-523c-4e99-abe8-e0bfc981c2bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83114) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-051360a5-7731-4c3f-99ea-9c4ad3c36833-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-051360a5-7731-4c3f-99ea-9c4ad3c36833-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b9e545-f719-4b2b-90c1-248b5bf28932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6764a620-2c07-41b7-826e-91d278101a37', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a39b228-2051-47fe-a045-dc6952fe60dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:50 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Volume volume-6764a620-2c07-41b7-826e-91d278101a37 (6764a620-2c07-41b7-826e-91d278101a37): created successfully Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a39b228-2051-47fe-a045-dc6952fe60dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Flow 'volume_create_manager' (f5f1842c-24e5-4411-abfa-137cdb0c92e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:50 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-98b0dad5-6901-43f6-8fc8-6a9008f208f2 tempest-VolumesExtendTest-243091603 None] Created volume successfully. Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-051360a5-7731-4c3f-99ea-9c4ad3c36833" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-051360a5-7731-4c3f-99ea-9c4ad3c36833" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea70f4f-ba8e-480e-b4d1-aabee9ce2e24]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:50 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 Feb 27 12:35:50 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:51 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833" returned: 0 in 0.593s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:51 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833 Feb 27 12:35:51 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:51 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[743535af-36b0-408d-aa76-e88cababa17d]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:52 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:52 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:52 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-051360a5-7731-4c3f-99ea-9c4ad3c36833" returned: 0 in 0.692s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-051360a5-7731-4c3f-99ea-9c4ad3c36833" released by "delete_volume" :: held 1.310s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['2e14334a-a3c0-40b3-8f4b-2e2e97f19405', '0af61afa-e18d-45dc-a1c2-ac59c4f31e8d', '213c5432-aac6-4d97-a06c-6d321f3b733c', 'a1034e74-d716-494b-a545-26caf51a0a9b'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:52 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:52 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:52 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 0 in 0.564s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:52 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:52 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:52 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.552s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:52 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Deleted volume successfully. Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-945d9419-bba0-49a6-9d6d-55e2d9b23ec8 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-051360a5-7731-4c3f-99ea-9c4ad3c36833-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-f60822e6-27a9-4221-96b9-6ddcd1b8b248-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-f60822e6-27a9-4221-96b9-6ddcd1b8b248-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:52 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-c1e23a55-b8c5-44ee-9d99-276411277dcc" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-c1e23a55-b8c5-44ee-9d99-276411277dcc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-f60822e6-27a9-4221-96b9-6ddcd1b8b248" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-f60822e6-27a9-4221-96b9-6ddcd1b8b248" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Deleting offline snapshot f60822e6-27a9-4221-96b9-6ddcd1b8b248 of volume c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] snapshot_file for this snap is: volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b3361d-3299-4946-90b5-ea1556682abe]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:53 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 Feb 27 12:35:53 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:53 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 1 in 0.731s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 2G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 2G" returned: 0 in 0.053s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.384s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:53 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-06696721-1012-4bb7-8861-1d3fbb13f10b tempest-VolumesExtendTest-243091603 None] Extend volume completed successfully. Feb 27 12:35:53 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248" returned: 0 in 0.655s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1e23a55-b8c5-44ee-9d99-276411277dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315b7f1-ff00-4c83-bc49-319157dbae13]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:53 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc Feb 27 12:35:53 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:54 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc" returned: 0 in 0.597s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Acquiring lock "cinder-6764a620-2c07-41b7-826e-91d278101a37-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:54 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 Feb 27 12:35:54 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Lock "cinder-6764a620-2c07-41b7-826e-91d278101a37-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Acquiring lock "cinder-quobyte-6764a620-2c07-41b7-826e-91d278101a37" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-6764a620-2c07-41b7-826e-91d278101a37" acquired by "delete_volume" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacca4b9-4b0f-48d8-a146-965654238534]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:54 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:54 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:54 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248" returned: 0 in 0.592s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:54 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248 Feb 27 12:35:54 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:55 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 0 in 0.660s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:55 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:55 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:55 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc.f60822e6-27a9-4221-96b9-6ddcd1b8b248" returned: 0 in 0.532s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-f60822e6-27a9-4221-96b9-6ddcd1b8b248" released by "_delete_snapshot" :: held 2.462s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-c1e23a55-b8c5-44ee-9d99-276411277dcc" released by "delete_snapshot" :: held 2.482s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['c3f7075d-2025-4daf-94b9-d066f32a8087', '25db4c12-bce3-4c44-80d2-b16f8d90f475', '1e6a3584-d613-4c36-993f-43330d3140ca', 'a628f75c-d2d7-4646-a655-ed8f7b2c51c0'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:55 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Delete snapshot completed successfully. Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58e83d57-a460-43d4-850b-41eeea044d1c tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-f60822e6-27a9-4221-96b9-6ddcd1b8b248-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:55 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 1 in 0.682s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:55 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37 Feb 27 12:35:55 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Flow 'volume_create_manager' (99c51212-bd3c-4873-85f5-7ac0c8f0f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b0cf85-2964-4128-85b1-4561342bc843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b0cf85-2964-4128-85b1-4561342bc843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1031157448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cae7e5d-ae00-446d-b47b-af17a826ea16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ea6caa303d4df3947b54e2ebf4739f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:56Z,use_quota=True,user_id='041cb8bbf7b74a24bf8b30e322c7e688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5753c89-f5bc-4755-be2e-670ec47adec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5753c89-f5bc-4755-be2e-670ec47adec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38be3a7f-a423-4b5d-8729-56b0788542f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38be3a7f-a423-4b5d-8729-56b0788542f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cae7e5d-ae00-446d-b47b-af17a826ea16', 'volume_name': 'volume-0cae7e5d-ae00-446d-b47b-af17a826ea16', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8ae693-06e0-4bfc-a132-cbae135d4379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8ae693-06e0-4bfc-a132-cbae135d4379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d3cb32-62c0-42e5-bcf3-3c173b3eb45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:56 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Volume 0cae7e5d-ae00-446d-b47b-af17a826ea16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cae7e5d-ae00-446d-b47b-af17a826ea16', 'volume_size': 1} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1031157448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cae7e5d-ae00-446d-b47b-af17a826ea16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ea6caa303d4df3947b54e2ebf4739f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:56Z,use_quota=True,user_id='041cb8bbf7b74a24bf8b30e322c7e688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Creating volume 0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:56 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:56 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 1073741824 Feb 27 12:35:56 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-c1e23a55-b8c5-44ee-9d99-276411277dcc-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-c1e23a55-b8c5-44ee-9d99-276411277dcc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-c1e23a55-b8c5-44ee-9d99-276411277dcc" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-c1e23a55-b8c5-44ee-9d99-276411277dcc" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[224a6be2-9af1-45df-ad2c-7da0f4c9c89f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:56 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc Feb 27 12:35:56 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:56 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-6764a620-2c07-41b7-826e-91d278101a37" returned: 0 in 0.630s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-6764a620-2c07-41b7-826e-91d278101a37" released by "delete_volume" :: held 2.021s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Created reservations ['f1ef295b-ecd0-4054-b224-9fda0a248ee2', '3e5b6b98-17f2-4434-9e9a-569749a43b29', 'f8b6015a-dd0c-4592-8c6d-a7b040ab344a', 'e1473f82-ff9c-4f7d-9e48-31940f57471e'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:56 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:56 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:35:57 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:57 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Flow 'volume_create_manager' (e0fe6765-898a-41c4-a1e6-4fe41f15889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6085f14d-a254-4a3f-8e89-39ea7f6e83a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc" returned: 0 in 0.719s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 1073741824" returned: 0 in 1.000s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:57 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:57 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6085f14d-a254-4a3f-8e89-39ea7f6e83a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-140876509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d902514-32fa-42ca-ac77-939d3b665a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2ce12ef57b44c5aa61596ef432ae19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:57Z,use_quota=True,user_id='e4b8a6746b0f4559a158d915faa86ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:57 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba40a7f-7de3-467a-bfe9-c74215d578d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba40a7f-7de3-467a-bfe9-c74215d578d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ef4dcd-e965-48b3-9989-489ab805de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ef4dcd-e965-48b3-9989-489ab805de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d902514-32fa-42ca-ac77-939d3b665a5e', 'volume_name': 'volume-7d902514-32fa-42ca-ac77-939d3b665a5e', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc22e74-0497-4021-a511-8cec40f46ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc22e74-0497-4021-a511-8cec40f46ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a83e752-a38a-4844-bd54-dfa871453503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:57 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Volume 7d902514-32fa-42ca-ac77-939d3b665a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d902514-32fa-42ca-ac77-939d3b665a5e', 'volume_size': 1} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Deleted volume successfully. Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-75f0caa4-2e5f-44f7-b6bc-8b0d1ac20abd tempest-VolumesExtendTest-243091603 None] Lock "cinder-6764a620-2c07-41b7-826e-91d278101a37-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:57 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 Feb 27 12:35:57 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:57 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e23a55-b8c5-44ee-9d99-276411277dcc" returned: 0 in 0.433s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-c1e23a55-b8c5-44ee-9d99-276411277dcc" released by "delete_volume" :: held 1.188s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['429bac49-768a-4324-b0bd-878929321056', '49498e7a-22b2-42ea-904c-6efa184a874e', '2cd05d0d-d421-4506-8347-eecaf8e43ed1', 'aa9fa553-bb7a-4af9-8cec-7eec58e995fb'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:57 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16" returned: 0 in 0.410s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-140876509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d902514-32fa-42ca-ac77-939d3b665a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b2ce12ef57b44c5aa61596ef432ae19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:35:57Z,use_quota=True,user_id='e4b8a6746b0f4559a158d915faa86ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Creating volume 7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:35:57 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:57 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e 1073741824 Feb 27 12:35:57 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d3cb32-62c0-42e5-bcf3-3c173b3eb45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cae7e5d-ae00-446d-b47b-af17a826ea16', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc3a16b-35eb-4b0a-a6e3-873afa4b2948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:57 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Volume volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 (0cae7e5d-ae00-446d-b47b-af17a826ea16): created successfully Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc3a16b-35eb-4b0a-a6e3-873afa4b2948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Flow 'volume_create_manager' (99c51212-bd3c-4873-85f5-7ac0c8f0f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-58532f61-f750-4973-a58c-f091b3500c12 req-71b4f033-439e-45a2-9ac7-989bd2d3a352 tempest-VolumesSnapshotsTestJSON-1575863146 None] Created volume successfully. Feb 27 12:35:57 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:57 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:58 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.410s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:35:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Deleted volume successfully. Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-102106d0-cd11-4b86-a599-394488e9d557 tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-c1e23a55-b8c5-44ee-9d99-276411277dcc-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:58 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e 1073741824" returned: 0 in 0.485s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:58 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e Feb 27 12:35:58 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-e41f3036-ce81-4a69-8c8f-902977c505ed-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:58 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-e41f3036-ce81-4a69-8c8f-902977c505ed-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e" returned: 0 in 0.441s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.195s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a83e752-a38a-4844-bd54-dfa871453503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d902514-32fa-42ca-ac77-939d3b665a5e', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b235c89-daed-4471-a673-2869df250e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Creating offline snapshot c5eb7633-09cd-459a-bb4c-25c3ba82e592 of volume 0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d7fb47-682f-488c-8da8-840d73737209]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:58 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Volume volume-7d902514-32fa-42ca-ac77-939d3b665a5e (7d902514-32fa-42ca-ac77-939d3b665a5e): created successfully Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b235c89-daed-4471-a673-2869df250e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Flow 'volume_create_manager' (e0fe6765-898a-41c4-a1e6-4fe41f15889f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "cinder-quobyte-e41f3036-ce81-4a69-8c8f-902977c505ed" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:35:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ac3b1cf8-61b2-481d-9149-78082d848c21 tempest-VolumesExtendTest-243091603 None] Created volume successfully. Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-e41f3036-ce81-4a69-8c8f-902977c505ed" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00ce16-0cb0-4aa0-94f6-087656189608]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:35:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:58 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 Feb 27 12:35:58 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:58 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed Feb 27 12:35:58 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:59 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16" returned: 0 in 0.509s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:59 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 1G Feb 27 12:35:59 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:59 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed" returned: 0 in 0.491s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:59 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed Feb 27 12:35:59 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:59 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e41f3036-ce81-4a69-8c8f-902977c505ed" returned: 0 in 0.421s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-quobyte-e41f3036-ce81-4a69-8c8f-902977c505ed" released by "delete_volume" :: held 0.949s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Created reservations ['47a5c0c5-5c93-4870-bf8b-db2f9ddcd28d', 'f13d2ef6-47e9-4351-acc8-d1d3c02643bf', '601e312d-ccc9-44b0-b944-694e0a16089c', '39df0a2a-c7c7-4da8-be8e-f04373d2cf49'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:35:59 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 1G" returned: 0 in 0.534s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:59 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 Feb 27 12:35:59 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:35:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:35:59 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:35:59 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:00 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.456s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:00 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:00 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Deleted volume successfully. Feb 27 12:36:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5b4f367-f077-4d1b-8893-6274bd8e0c3d tempest-VolumesSnapshotTestJSON-841487923 None] Lock "cinder-e41f3036-ce81-4a69-8c8f-902977c505ed-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:00 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592" returned: 0 in 0.585s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:00 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 is being set with open permissions: ugo+rw Feb 27 12:36:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:00 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 Feb 27 12:36:00 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:00 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592" returned: 0 in 0.494s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:00 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.info Feb 27 12:36:00 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:01 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.info" returned: 0 in 0.494s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:01 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.info is being set with open permissions: ugo+rw Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:01 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.info Feb 27 12:36:01 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:01 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.info" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.506s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Creating offline snapshot f7f32c06-fc7e-42ff-8be8-97c6ad56e817 of volume 7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:36:01 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-838f9452-3aee-4008-8e4c-dce7fc45f1c1 req-80f28c03-9775-4b16-a3f1-aa8d75a6638f tempest-VolumesSnapshotsTestJSON-1575863146 None] Create snapshot completed successfully Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea77239-929f-49fb-aec7-d9d2db542cea]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:01 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e Feb 27 12:36:01 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "cinder-c5eb7633-09cd-459a-bb4c-25c3ba82e592-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-c5eb7633-09cd-459a-bb4c-25c3ba82e592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "cinder-quobyte-0cae7e5d-ae00-446d-b47b-af17a826ea16" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-quobyte-0cae7e5d-ae00-446d-b47b-af17a826ea16" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "cinder-quobyte-c5eb7633-09cd-459a-bb4c-25c3ba82e592" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-quobyte-c5eb7633-09cd-459a-bb4c-25c3ba82e592" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Deleting offline snapshot c5eb7633-09cd-459a-bb4c-25c3ba82e592 of volume 0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] snapshot_file for this snap is: volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3e3bb5-cc92-433e-acda-28e2a6848eaa]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:02 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 Feb 27 12:36:02 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:02 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e" returned: 0 in 0.620s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:02 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 1G Feb 27 12:36:02 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:02 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592" returned: 0 in 0.648s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cae7e5d-ae00-446d-b47b-af17a826ea16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d9b7b-e05f-4ba9-86e8-925a2510352f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:02 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 1G" returned: 0 in 0.538s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d902514-32fa-42ca-ac77-939d3b665a5e -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:02 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 Feb 27 12:36:02 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:02 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d902514-32fa-42ca-ac77-939d3b665a5e -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 Feb 27 12:36:02 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:03 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16" returned: 0 in 0.585s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:03 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 Feb 27 12:36:03 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:03 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d902514-32fa-42ca-ac77-939d3b665a5e -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817" returned: 0 in 0.558s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:03 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 is being set with open permissions: ugo+rw Feb 27 12:36:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:03 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 Feb 27 12:36:03 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:04 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:04 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592" returned: 0 in 0.609s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817" returned: 0 in 0.565s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:04 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592 Feb 27 12:36:04 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:04 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.info Feb 27 12:36:04 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:04 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16.c5eb7633-09cd-459a-bb4c-25c3ba82e592" returned: 0 in 0.495s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-quobyte-c5eb7633-09cd-459a-bb4c-25c3ba82e592" released by "_delete_snapshot" :: held 2.414s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-quobyte-0cae7e5d-ae00-446d-b47b-af17a826ea16" released by "delete_snapshot" :: held 2.431s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG cinder.quota [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Created reservations ['fd2d8974-ce9e-466b-a0a3-a2934f625a97', '710c9db5-8a1e-4fd5-a634-4c902cc8816d', '427020e0-d75e-4629-853c-865e719db4f6', 'a11045b8-429b-4ec9-add2-04f6dc510954'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:04 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.info" returned: 0 in 0.567s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:04 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.info is being set with open permissions: ugo+rw Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:04 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.info Feb 27 12:36:04 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:04 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Delete snapshot completed successfully. Feb 27 12:36:04 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-b64679f0-01d6-4aad-aaea-0ba528fdf29b req-5155d7cc-bf05-4b7e-9c29-82e0bddfa430 tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-c5eb7633-09cd-459a-bb4c-25c3ba82e592-delete_snapshot" released by "delete_snapshot" :: held 2.564s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:05 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.info" returned: 0 in 0.471s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.415s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:05 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-32625193-4303-4934-9a34-9d60d463a52c tempest-VolumesExtendTest-243091603 None] Create snapshot completed successfully Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Flow 'volume_create_manager' (5b80496f-f4f3-4f42-ba47-857856e391a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f5ec81-e87f-404b-bc07-754ea0c5b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f5ec81-e87f-404b-bc07-754ea0c5b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396608ee-e668-4682-97dd-a69f07a1748b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eeee093dbcf416991e6f311a9bb59ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:05Z,use_quota=True,user_id='51c5d57f1fde4df6a8df49d9666d0e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0473a362-6c2a-4cec-acc7-8ded8a7948fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0473a362-6c2a-4cec-acc7-8ded8a7948fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d959263-a98c-4962-9746-a4acf507ac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d959263-a98c-4962-9746-a4acf507ac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396608ee-e668-4682-97dd-a69f07a1748b', 'volume_name': 'volume-396608ee-e668-4682-97dd-a69f07a1748b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd5b61f-a615-4683-9bbe-33a0a9c0d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd5b61f-a615-4683-9bbe-33a0a9c0d150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedb99dc-14ee-480e-bad6-8f85ea9cec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:05 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Volume 396608ee-e668-4682-97dd-a69f07a1748b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396608ee-e668-4682-97dd-a69f07a1748b', 'volume_size': 1} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396608ee-e668-4682-97dd-a69f07a1748b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eeee093dbcf416991e6f311a9bb59ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:05Z,use_quota=True,user_id='51c5d57f1fde4df6a8df49d9666d0e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Creating volume 396608ee-e668-4682-97dd-a69f07a1748b {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:05 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "cinder-0cae7e5d-ae00-446d-b47b-af17a826ea16-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-0cae7e5d-ae00-446d-b47b-af17a826ea16-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:05 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b 1073741824 Feb 27 12:36:05 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "cinder-quobyte-0cae7e5d-ae00-446d-b47b-af17a826ea16" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-quobyte-0cae7e5d-ae00-446d-b47b-af17a826ea16" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eec0818-1034-4145-ad47-2923d66267bd]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:05 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 Feb 27 12:36:05 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:05 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b 1073741824" returned: 0 in 0.542s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:05 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b Feb 27 12:36:05 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:06 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16" returned: 0 in 0.494s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:06 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16 Feb 27 12:36:06 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:06 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b" returned: 0 in 0.433s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.877s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedb99dc-14ee-480e-bad6-8f85ea9cec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396608ee-e668-4682-97dd-a69f07a1748b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf629b5-06e2-4dda-ae52-c3573af98a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da708c-b389-43c0-a55d-5d980a4dc75e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:06 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Volume volume-396608ee-e668-4682-97dd-a69f07a1748b (396608ee-e668-4682-97dd-a69f07a1748b): created successfully Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf629b5-06e2-4dda-ae52-c3573af98a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Flow 'volume_create_manager' (5b80496f-f4f3-4f42-ba47-857856e391a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:06 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-35f0dc8a-77b0-4b26-83d3-3f0af8ca8d00 tempest-CinderUnicodeTest-1513774566 None] Created volume successfully. Feb 27 12:36:06 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-0cae7e5d-ae00-446d-b47b-af17a826ea16" returned: 0 in 0.434s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-quobyte-0cae7e5d-ae00-446d-b47b-af17a826ea16" released by "delete_volume" :: held 0.989s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:06 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e Feb 27 12:36:06 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.quota [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Created reservations ['c8bb5623-a0ee-4993-9d39-9c7b2edc85e4', 'e446b0ba-da8e-449f-b860-34d2b77a617a', 'ba932336-f88e-47df-bb51-3f17a95a0652', '9aeccfec-ddf9-40c8-ba27-aa71f4bf4cde'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:06 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:06 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:06 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e" returned: 0 in 0.527s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 2G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:06 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.435s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:06 devstack cinder-volume[83114]: DEBUG cinder.manager [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:06 devstack cinder-volume[83114]: INFO cinder.volume.manager [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Deleted volume successfully. Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [req-686ea0b3-d49c-46fa-bd9c-623fdcd98c56 req-70f1093b-7fcf-4e8a-b7c2-24fdbbac82cd tempest-VolumesSnapshotsTestJSON-1575863146 None] Lock "cinder-0cae7e5d-ae00-446d-b47b-af17a826ea16-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 2G" returned: 0 in 0.075s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.626s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:07 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-498f0812-0185-47d6-9fca-456c5fb428a5 tempest-VolumesExtendTest-243091603 None] Extend volume completed successfully. Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:07 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:07 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Flow 'volume_create_manager' (2f77a660-b350-432b-928e-fb78c69b370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c2645d-d6aa-434e-93b2-2ae32f97b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c2645d-d6aa-434e-93b2-2ae32f97b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1213352515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddebb9ef-f07c-40d6-acef-e6e15798e3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eeee093dbcf416991e6f311a9bb59ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:08Z,use_quota=True,user_id='51c5d57f1fde4df6a8df49d9666d0e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432f8768-9278-4d7f-9f01-913e6c1998fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432f8768-9278-4d7f-9f01-913e6c1998fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aba136-dff7-42da-9bfe-c76c1d903d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aba136-dff7-42da-9bfe-c76c1d903d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddebb9ef-f07c-40d6-acef-e6e15798e3e7', 'volume_name': 'volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904f4787-24d8-4e9c-b1f2-0c9d99077084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904f4787-24d8-4e9c-b1f2-0c9d99077084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c87e52-e40f-43b1-b115-a63e715b33f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:07 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Volume ddebb9ef-f07c-40d6-acef-e6e15798e3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7', 'volume_size': 1} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1213352515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddebb9ef-f07c-40d6-acef-e6e15798e3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eeee093dbcf416991e6f311a9bb59ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:08Z,use_quota=True,user_id='51c5d57f1fde4df6a8df49d9666d0e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Creating volume ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:07 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Acquiring lock "cinder-f7f32c06-fc7e-42ff-8be8-97c6ad56e817-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Lock "cinder-f7f32c06-fc7e-42ff-8be8-97c6ad56e817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Acquiring lock "cinder-quobyte-7d902514-32fa-42ca-ac77-939d3b665a5e" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:07 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 1073741824 Feb 27 12:36:07 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-7d902514-32fa-42ca-ac77-939d3b665a5e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Acquiring lock "cinder-quobyte-f7f32c06-fc7e-42ff-8be8-97c6ad56e817" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-f7f32c06-fc7e-42ff-8be8-97c6ad56e817" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Deleting offline snapshot f7f32c06-fc7e-42ff-8be8-97c6ad56e817 of volume 7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] snapshot_file for this snap is: volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[75def1b8-d3d7-417b-b5a2-3e1252fae8d1]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:07 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:07 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:07 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 Feb 27 12:36:07 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:08 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 1073741824" returned: 0 in 0.581s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:08 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 Feb 27 12:36:08 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:08 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817" returned: 0 in 0.621s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d902514-32fa-42ca-ac77-939d3b665a5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c84ec-e653-4410-91ae-fa031a47096e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:08 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e Feb 27 12:36:08 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:08 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" returned: 0 in 0.529s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c87e52-e40f-43b1-b115-a63e715b33f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52af3c25-8baf-408e-aa44-7615c2f62330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:08 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Volume volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 (ddebb9ef-f07c-40d6-acef-e6e15798e3e7): created successfully Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52af3c25-8baf-408e-aa44-7615c2f62330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Flow 'volume_create_manager' (2f77a660-b350-432b-928e-fb78c69b370b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-596f0517-3be9-4d28-adb4-409c1840dd11 tempest-CinderUnicodeTest-1513774566 None] Created volume successfully. Feb 27 12:36:09 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e" returned: 0 in 0.586s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:09 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 Feb 27 12:36:09 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:09 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817" returned: 0 in 0.553s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:09 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817 Feb 27 12:36:09 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:09 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=127,cinder:UPDATE=151,cinder:INSERT=39,cinder:DELETE=17 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:UPDATE=154,cinder:SELECT=122,cinder:DELETE=9,cinder:INSERT=46 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Creating offline snapshot 663ba5ec-3353-4aeb-8305-b840d377dbd1 of volume ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadbe7aa-8fc5-4819-b639-cce30fa13eff]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:10 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 Feb 27 12:36:10 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:10 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e.f7f32c06-fc7e-42ff-8be8-97c6ad56e817" returned: 0 in 0.560s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-f7f32c06-fc7e-42ff-8be8-97c6ad56e817" released by "_delete_snapshot" :: held 2.382s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-7d902514-32fa-42ca-ac77-939d3b665a5e" released by "delete_snapshot" :: held 2.398s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Created reservations ['c59b49d1-1b32-4ca3-a071-7dc913417c75', '81c23ae9-d82b-432a-b652-7fb4d38bd884', '21a294b6-60c8-4b37-b68e-9fe902b6e095', 'a08cab49-c1b0-4fa6-ba34-e13f925a6380'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Delete snapshot completed successfully. Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-abead169-a744-46bb-81af-da5179a53b07 tempest-VolumesExtendTest-243091603 None] Lock "cinder-f7f32c06-fc7e-42ff-8be8-97c6ad56e817-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Flow 'volume_create_manager' (c76aadb5-1d24-4af3-a635-5a03f1c62a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da162307-191e-4b07-a527-381b0148d4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da162307-191e-4b07-a527-381b0148d4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-750368084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7bd662-04a9-4610-b342-d2c794cbbf6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbabf14529b44aba9f562d86a7a97db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:10Z,use_quota=True,user_id='b0d3563ae6b041b2a6b08b154ac52a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46da07a-a2db-453a-8b56-c6adafb288a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46da07a-a2db-453a-8b56-c6adafb288a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517180d7-606d-4f11-a47c-c9d3b93cfe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517180d7-606d-4f11-a47c-c9d3b93cfe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7bd662-04a9-4610-b342-d2c794cbbf6f', 'volume_name': 'volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851ee87-74b0-4e8f-a5a7-c0e24af12398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7851ee87-74b0-4e8f-a5a7-c0e24af12398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f52671-42f4-4b75-b531-13eac04c8183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:10 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Volume ce7bd662-04a9-4610-b342-d2c794cbbf6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f', 'volume_size': 1} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:10 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" returned: 0 in 0.563s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:10 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 1G Feb 27 12:36:10 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Acquiring lock "cinder-7d902514-32fa-42ca-ac77-939d3b665a5e-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Lock "cinder-7d902514-32fa-42ca-ac77-939d3b665a5e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Acquiring lock "cinder-quobyte-7d902514-32fa-42ca-ac77-939d3b665a5e" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-7d902514-32fa-42ca-ac77-939d3b665a5e" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4609ee6-b8a3-4d6e-b69f-3749337300c0]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:11 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 1G" returned: 0 in 0.549s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:11 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e Feb 27 12:36:11 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:11 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 Feb 27 12:36:11 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:11 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e" returned: 0 in 0.516s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:11 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e Feb 27 12:36:11 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:11 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:11 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 is being set with open permissions: ugo+rw Feb 27 12:36:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:11 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 Feb 27 12:36:11 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:12 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7d902514-32fa-42ca-ac77-939d3b665a5e" returned: 0 in 0.409s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Lock "cinder-quobyte-7d902514-32fa-42ca-ac77-939d3b665a5e" released by "delete_volume" :: held 0.964s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Created reservations ['8cd73821-216a-4a99-9997-cd8015c46986', '0deb122a-d504-4be2-b6ff-6afd539229a2', '36a8a49f-8c7c-45c6-9ea8-acb8ca136b5f', 'afecbeec-1810-4a4f-877a-88f22d1c7a41'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:12 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1" returned: 0 in 0.430s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:12 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.info Feb 27 12:36:12 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:12 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:12 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:12 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.info" returned: 0 in 0.427s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:12 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.info is being set with open permissions: ugo+rw Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:12 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.info Feb 27 12:36:12 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:12 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.418s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Deleted volume successfully. Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1915125e-2ab3-4037-84ed-0d81babd41a3 tempest-VolumesExtendTest-243091603 None] Lock "cinder-7d902514-32fa-42ca-ac77-939d3b665a5e-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:12 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.info" returned: 0 in 0.403s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.500s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-750368084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7bd662-04a9-4610-b342-d2c794cbbf6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbabf14529b44aba9f562d86a7a97db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:10Z,use_quota=True,user_id='b0d3563ae6b041b2a6b08b154ac52a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Creating volume ce7bd662-04a9-4610-b342-d2c794cbbf6f {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:12 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:12 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f 1073741824 Feb 27 12:36:12 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6bfc3750-61d5-4048-a197-9386f72d5fd1 tempest-CinderUnicodeTest-1513774566 None] Create snapshot completed successfully Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "cinder-663ba5ec-3353-4aeb-8305-b840d377dbd1-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-663ba5ec-3353-4aeb-8305-b840d377dbd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "cinder-quobyte-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "cinder-quobyte-663ba5ec-3353-4aeb-8305-b840d377dbd1" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-663ba5ec-3353-4aeb-8305-b840d377dbd1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Deleting offline snapshot 663ba5ec-3353-4aeb-8305-b840d377dbd1 of volume ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] snapshot_file for this snap is: volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04d8218-13ab-4645-8bf5-a67ee0cd10b8]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:13 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 Feb 27 12:36:13 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:13 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f 1073741824" returned: 0 in 0.575s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:13 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f Feb 27 12:36:13 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:13 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1" returned: 0 in 0.636s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e0043-7eb9-4dbc-b818-9e8b483c96ef]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:13 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 Feb 27 12:36:13 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:14 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f" returned: 0 in 0.449s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f52671-42f4-4b75-b531-13eac04c8183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6f0f5c-6454-4aba-b69a-e30cf3b1c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:14 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Volume volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f (ce7bd662-04a9-4610-b342-d2c794cbbf6f): created successfully Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6f0f5c-6454-4aba-b69a-e30cf3b1c441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Flow 'volume_create_manager' (c76aadb5-1d24-4af3-a635-5a03f1c62a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d50adfe8-d1d7-434e-8054-4cf497924e80 tempest-VolumesTestJSON-1104664905 None] Created volume successfully. Feb 27 12:36:14 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" returned: 0 in 0.556s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:14 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 Feb 27 12:36:14 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Flow 'volume_create_manager' (f9bf412a-59f4-45cc-b1b3-5040a5b16dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:14 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2924d426-6998-438a-92d1-c3c42ab33d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2924d426-6998-438a-92d1-c3c42ab33d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-646715682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2447192c-7232-4818-a4f5-875670be6049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbabf14529b44aba9f562d86a7a97db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:15Z,use_quota=True,user_id='b0d3563ae6b041b2a6b08b154ac52a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffa7104-60ca-4783-a4b7-bb41d9a77322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffa7104-60ca-4783-a4b7-bb41d9a77322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b52d78-4df6-4607-9115-c8096b615e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b52d78-4df6-4607-9115-c8096b615e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2447192c-7232-4818-a4f5-875670be6049', 'volume_name': 'volume-2447192c-7232-4818-a4f5-875670be6049', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca49a20-6efa-47cf-bfab-f9fcae789fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca49a20-6efa-47cf-bfab-f9fcae789fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c00f6d-9211-4de6-bbcd-2b9b23843c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:14 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Volume 2447192c-7232-4818-a4f5-875670be6049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2447192c-7232-4818-a4f5-875670be6049', 'volume_size': 1} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-646715682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2447192c-7232-4818-a4f5-875670be6049,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbabf14529b44aba9f562d86a7a97db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:15Z,use_quota=True,user_id='b0d3563ae6b041b2a6b08b154ac52a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Creating volume 2447192c-7232-4818-a4f5-875670be6049 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:15 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1" returned: 0 in 0.598s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:15 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 1073741824 Feb 27 12:36:15 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:15 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1 Feb 27 12:36:15 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (4a5c028c-4ef6-43f7-b18c-a7371e5cab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b33c55-ca5c-4d9b-ba2f-3029336fa3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b33c55-ca5c-4d9b-ba2f-3029336fa3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871899860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3b42c0-355c-4ec1-94e3-b606041d9801,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:15Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2e3e58-3f81-4363-b2c1-67b1fda15e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2e3e58-3f81-4363-b2c1-67b1fda15e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a858ca90-6ad6-4366-b43a-1a8f795a7514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a858ca90-6ad6-4366-b43a-1a8f795a7514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3b42c0-355c-4ec1-94e3-b606041d9801', 'volume_name': 'volume-de3b42c0-355c-4ec1-94e3-b606041d9801', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5d9a87-5455-4f68-aa84-9a4c45a6a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5d9a87-5455-4f68-aa84-9a4c45a6a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8052ed7-d0e1-4c6c-9c12-c79b9d739b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:15 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Volume de3b42c0-355c-4ec1-94e3-b606041d9801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3b42c0-355c-4ec1-94e3-b606041d9801', 'volume_size': 1} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:15 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:15 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 1073741824" returned: 0 in 0.507s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7.663ba5ec-3353-4aeb-8305-b840d377dbd1" returned: 0 in 0.497s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-663ba5ec-3353-4aeb-8305-b840d377dbd1" released by "_delete_snapshot" :: held 2.348s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" released by "delete_snapshot" :: held 2.363s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:15 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 Feb 27 12:36:15 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Created reservations ['df5e5c7c-0122-4b21-b65c-adaf5c313db6', 'e819d546-40e8-431a-b51d-e1c8e3c8072f', 'dfab32e1-dce3-4fd1-a10e-fe9e7f8be143', '23801776-e4c9-4682-9046-dc00bc0e6b69'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:15 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Delete snapshot completed successfully. Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7ff2fb1f-c3e5-4cd3-9ab6-0676c45ad3f6 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-663ba5ec-3353-4aeb-8305-b840d377dbd1-delete_snapshot" released by "delete_snapshot" :: held 2.471s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:15 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049" returned: 0 in 0.404s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1871899860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3b42c0-355c-4ec1-94e3-b606041d9801,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:15Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Creating volume de3b42c0-355c-4ec1-94e3-b606041d9801 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:15 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:15 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c00f6d-9211-4de6-bbcd-2b9b23843c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2447192c-7232-4818-a4f5-875670be6049', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02508c38-da22-43be-b068-987bfcf6a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:16 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 1073741824 Feb 27 12:36:16 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:16 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Volume volume-2447192c-7232-4818-a4f5-875670be6049 (2447192c-7232-4818-a4f5-875670be6049): created successfully Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02508c38-da22-43be-b068-987bfcf6a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Flow 'volume_create_manager' (f9bf412a-59f4-45cc-b1b3-5040a5b16dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:16 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-26afdae9-5870-43b6-a0ea-f54d4fb8ad04 tempest-VolumesTestJSON-1104664905 None] Created volume successfully. Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "cinder-ddebb9ef-f07c-40d6-acef-e6e15798e3e7-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-ddebb9ef-f07c-40d6-acef-e6e15798e3e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "cinder-quobyte-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e632f8cc-38ec-479c-b9a8-4bba3cc557a4]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:16 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 1073741824" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:16 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 Feb 27 12:36:16 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:16 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 Feb 27 12:36:16 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:16 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:16 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801" returned: 0 in 0.440s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8052ed7-d0e1-4c6c-9c12-c79b9d739b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3b42c0-355c-4ec1-94e3-b606041d9801', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2634b13e-bf45-4556-baaa-8e0b27c296d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:16 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7 Feb 27 12:36:16 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:16 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Volume volume-de3b42c0-355c-4ec1-94e3-b606041d9801 (de3b42c0-355c-4ec1-94e3-b606041d9801): created successfully Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2634b13e-bf45-4556-baaa-8e0b27c296d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:16 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (4a5c028c-4ef6-43f7-b18c-a7371e5cab7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:16 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-62be36ff-9c92-4ca0-bf68-c098d34fc629 tempest-VolumesGetTest-442158571 None] Created volume successfully. Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Flow 'volume_create_manager' (da68d242-ff2f-4815-bf0a-bc9c9556ddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a927ac73-91f4-4c12-b811-5786b3101bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a927ac73-91f4-4c12-b811-5786b3101bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2016796345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0ebe84-aa12-4539-87c7-eadc014c201d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbabf14529b44aba9f562d86a7a97db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:17Z,use_quota=True,user_id='b0d3563ae6b041b2a6b08b154ac52a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0deb2c-f1d5-4ab3-b430-7269d580a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0deb2c-f1d5-4ab3-b430-7269d580a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d288f2-083e-4123-8ea9-52cba07627fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d288f2-083e-4123-8ea9-52cba07627fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0ebe84-aa12-4539-87c7-eadc014c201d', 'volume_name': 'volume-af0ebe84-aa12-4539-87c7-eadc014c201d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c98a27a-2d00-487d-9b5c-754ad3e3ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c98a27a-2d00-487d-9b5c-754ad3e3ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450d39d7-24dd-4620-ad88-a9f6ab421293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Volume af0ebe84-aa12-4539-87c7-eadc014c201d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0ebe84-aa12-4539-87c7-eadc014c201d', 'volume_size': 1} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2016796345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0ebe84-aa12-4539-87c7-eadc014c201d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bbabf14529b44aba9f562d86a7a97db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:17Z,use_quota=True,user_id='b0d3563ae6b041b2a6b08b154ac52a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Creating volume af0ebe84-aa12-4539-87c7-eadc014c201d {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:17 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:17 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d 1073741824 Feb 27 12:36:17 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:17 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" returned: 0 in 0.520s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-ddebb9ef-f07c-40d6-acef-e6e15798e3e7" released by "delete_volume" :: held 1.065s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Created reservations ['3a13485a-81d6-4acc-ad97-876da477d11b', '2ecaab88-7c26-455d-8318-a81e81f04ba0', '75ae4f17-d5a7-4c2c-9baf-7649ca7b8ae9', '8297e344-1260-4747-81cb-29e61928a493'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:17 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:17 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (ca49d22d-b28b-4bc6-be16-5e2a758a09c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3db94d0-feef-4eae-87d1-f13c7b77b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3db94d0-feef-4eae-87d1-f13c7b77b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1739124683',display_name='tempest-VolumesGetTest-Volume-1643827737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb8b685-a690-4a67-9837-5ccda1de10e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:18Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed29059f-ab8c-4a0d-9e0b-e0d215b13f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed29059f-ab8c-4a0d-9e0b-e0d215b13f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644d1430-524f-40bb-b242-2d30fb89ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644d1430-524f-40bb-b242-2d30fb89ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb8b685-a690-4a67-9837-5ccda1de10e0', 'volume_name': 'volume-bcb8b685-a690-4a67-9837-5ccda1de10e0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c1c1b5-d570-4bab-9068-68b59bbc5423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c1c1b5-d570-4bab-9068-68b59bbc5423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a01921-475d-43c5-a2af-81da8bc80195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:17 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Volume bcb8b685-a690-4a67-9837-5ccda1de10e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb8b685-a690-4a67-9837-5ccda1de10e0', 'volume_size': 1} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:17 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d 1073741824" returned: 0 in 0.572s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:18 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d Feb 27 12:36:18 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:18 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.473s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:18 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Deleted volume successfully. Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9d9f33f8-4a18-4cae-a187-8dc90c2cb7e2 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-ddebb9ef-f07c-40d6-acef-e6e15798e3e7-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:18 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d" returned: 0 in 0.413s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.499s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1739124683',display_name='tempest-VolumesGetTest-Volume-1643827737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb8b685-a690-4a67-9837-5ccda1de10e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:18Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Creating volume bcb8b685-a690-4a67-9837-5ccda1de10e0 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:18 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450d39d7-24dd-4620-ad88-a9f6ab421293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0ebe84-aa12-4539-87c7-eadc014c201d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a89670e-f922-4e58-9d2e-4f5d3d69aa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:18 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 1073741824 Feb 27 12:36:18 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Volume volume-af0ebe84-aa12-4539-87c7-eadc014c201d (af0ebe84-aa12-4539-87c7-eadc014c201d): created successfully Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a89670e-f922-4e58-9d2e-4f5d3d69aa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Flow 'volume_create_manager' (da68d242-ff2f-4815-bf0a-bc9c9556ddc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:18 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-67eac433-fbfe-4359-ab69-40ef56e1c8db tempest-VolumesTestJSON-1104664905 None] Created volume successfully. Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "cinder-396608ee-e668-4682-97dd-a69f07a1748b-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-396608ee-e668-4682-97dd-a69f07a1748b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "cinder-quobyte-396608ee-e668-4682-97dd-a69f07a1748b" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-396608ee-e668-4682-97dd-a69f07a1748b" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[98620b41-0d83-4d15-9f5a-76fb6464f08c]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:18 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b Feb 27 12:36:18 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:18 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 1073741824" returned: 0 in 0.535s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:18 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 Feb 27 12:36:18 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:19 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b" returned: 0 in 0.526s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:19 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b Feb 27 12:36:19 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:19 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0" returned: 0 in 0.408s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a01921-475d-43c5-a2af-81da8bc80195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb8b685-a690-4a67-9837-5ccda1de10e0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d26fd01-eed3-4ce7-9119-c83d64c64fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Volume volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 (bcb8b685-a690-4a67-9837-5ccda1de10e0): created successfully Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d26fd01-eed3-4ce7-9119-c83d64c64fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (ca49d22d-b28b-4bc6-be16-5e2a758a09c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c0f135b8-f902-4119-9972-5dfd903d966a tempest-VolumesGetTest-442158571 None] Created volume successfully. Feb 27 12:36:19 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-396608ee-e668-4682-97dd-a69f07a1748b" returned: 0 in 0.451s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-quobyte-396608ee-e668-4682-97dd-a69f07a1748b" released by "delete_volume" :: held 0.998s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Created reservations ['91f9e986-6437-49b5-8764-5d577ed4ec71', 'ca369c02-7504-4186-a59a-22babe995ede', 'cc2076bd-4cbd-4bac-81c0-a5a97ed6abad', '7bf8aa87-b88e-4952-b07d-f778166dc19a'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:19 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:19 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-bcb8b685-a690-4a67-9837-5ccda1de10e0-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Lock "cinder-bcb8b685-a690-4a67-9837-5ccda1de10e0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-bcb8b685-a690-4a67-9837-5ccda1de10e0" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-bcb8b685-a690-4a67-9837-5ccda1de10e0" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ecbda3-aae1-4eed-bfda-8081f9ffe6a5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:20 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Acquiring lock "cinder-af0ebe84-aa12-4539-87c7-eadc014c201d-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.487s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:20 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Deleted volume successfully. Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Lock "cinder-af0ebe84-aa12-4539-87c7-eadc014c201d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e05f0822-329f-4d9d-9d46-2029be695c10 tempest-CinderUnicodeTest-1513774566 None] Lock "cinder-396608ee-e668-4682-97dd-a69f07a1748b-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Acquiring lock "cinder-quobyte-af0ebe84-aa12-4539-87c7-eadc014c201d" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Lock "cinder-quobyte-af0ebe84-aa12-4539-87c7-eadc014c201d" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[453f64a8-4d68-4592-8cd3-6c5665eb6155]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:20 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 Feb 27 12:36:20 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:20 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d Feb 27 12:36:20 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:20 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0" returned: 0 in 0.561s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:20 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d" returned: 0 in 0.501s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:20 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0 Feb 27 12:36:20 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:20 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d Feb 27 12:36:20 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:21 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-af0ebe84-aa12-4539-87c7-eadc014c201d" returned: 0 in 0.450s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Lock "cinder-quobyte-af0ebe84-aa12-4539-87c7-eadc014c201d" released by "delete_volume" :: held 0.984s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:21 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bcb8b685-a690-4a67-9837-5ccda1de10e0" returned: 0 in 0.505s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-bcb8b685-a690-4a67-9837-5ccda1de10e0" released by "delete_volume" :: held 1.116s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Created reservations ['360587e6-dba2-4193-863f-0be8dd89a03f', 'b7cb17bc-11ca-40a2-a539-e13df99e58d9', '0f750cf2-0dfb-4d31-b1e5-13c85394950f', 'f6c76df9-8fbd-414a-80e8-030711445696'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Created reservations ['0e5b4732-7c88-40ff-8d8f-f06202820e6c', '4ac2c6a7-892a-4970-84e8-a3cad13aaec1', '2dd4ea3c-3f8c-4fb1-8a22-e2227dd29967', '647ec46e-cd77-4eb0-b4ec-98ed5f4266a9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:21 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:21 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:21 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:21 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:21 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.492s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Deleted volume successfully. Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c583a329-5c27-42cb-974e-ae420b22e7fd tempest-VolumesTestJSON-1104664905 None] Lock "cinder-af0ebe84-aa12-4539-87c7-eadc014c201d-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:21 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.476s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Deleted volume successfully. Feb 27 12:36:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-39f298cf-2508-423b-863e-5e0f4b5e4216 tempest-VolumesGetTest-442158571 None] Lock "cinder-bcb8b685-a690-4a67-9837-5ccda1de10e0-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-de3b42c0-355c-4ec1-94e3-b606041d9801-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Lock "cinder-de3b42c0-355c-4ec1-94e3-b606041d9801-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "cinder-2447192c-7232-4818-a4f5-875670be6049-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-de3b42c0-355c-4ec1-94e3-b606041d9801" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-2447192c-7232-4818-a4f5-875670be6049-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-de3b42c0-355c-4ec1-94e3-b606041d9801" acquired by "delete_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "cinder-quobyte-2447192c-7232-4818-a4f5-875670be6049" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a870a684-9615-4dc7-aec7-818f83435f47]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-quobyte-2447192c-7232-4818-a4f5-875670be6049" acquired by "delete_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca16d51-fed3-43b7-af6a-0588b792a607]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:22 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 Feb 27 12:36:22 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:22 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 Feb 27 12:36:22 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:22 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801" returned: 0 in 0.458s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:22 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801 Feb 27 12:36:22 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:22 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049" returned: 0 in 0.488s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:22 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049 Feb 27 12:36:22 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:23 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-de3b42c0-355c-4ec1-94e3-b606041d9801" returned: 0 in 0.417s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-de3b42c0-355c-4ec1-94e3-b606041d9801" released by "delete_volume" :: held 0.911s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Created reservations ['ce8cb6a3-4754-4d1a-8896-ee9e1ccebcb5', 'e946b5d1-19a1-4775-b9a6-8145396d9154', 'f44c648e-b09b-42e4-b6ad-a6f93b2f7252', 'd725a72c-ef87-460d-800c-e9547edc14ff'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:23 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2447192c-7232-4818-a4f5-875670be6049" returned: 0 in 0.447s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-quobyte-2447192c-7232-4818-a4f5-875670be6049" released by "delete_volume" :: held 0.962s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:23 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:23 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Created reservations ['32886f18-68ef-410f-a9e1-d7cd61706afc', '5b61ccb5-bad6-4c88-ae38-cc12e0396f69', 'd0d60763-b58a-4ad7-a941-93f1236ad630', '4b2da7c2-3e27-4a21-91de-28eeecfb8699'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:23 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:23 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (16963aea-e724-464d-b8a0-03b3596b1038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29258fe8-1a5c-4fc3-b352-a3e89d46fa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29258fe8-1a5c-4fc3-b352-a3e89d46fa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1127316156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b35296-cdfe-42be-8cf3-23cbf8728dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:24Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d6f40-430d-485d-bcca-3114127ebc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d6f40-430d-485d-bcca-3114127ebc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d183f0bc-47be-4af5-9c75-3574a834dc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d183f0bc-47be-4af5-9c75-3574a834dc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b35296-cdfe-42be-8cf3-23cbf8728dc0', 'volume_name': 'volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cd0c3c-6fb9-44f1-a3e6-ba390e4736ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cd0c3c-6fb9-44f1-a3e6-ba390e4736ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457b1ead-547c-4d0b-afd1-4671503a23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:23 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Volume 02b35296-cdfe-42be-8cf3-23cbf8728dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0', 'volume_size': 1} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1127316156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b35296-cdfe-42be-8cf3-23cbf8728dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:24Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Creating volume 02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:23 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:23 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 1073741824 Feb 27 12:36:23 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:23 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.524s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:23 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Deleted volume successfully. Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9f3e7924-39b2-48d8-9a63-7f2307b199cf tempest-VolumesGetTest-442158571 None] Lock "cinder-de3b42c0-355c-4ec1-94e3-b606041d9801-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:23 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.451s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:23 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Deleted volume successfully. Feb 27 12:36:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-41017875-18a2-488d-981f-b0a96987a9c9 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-2447192c-7232-4818-a4f5-875670be6049-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:24 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 1073741824" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:24 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 Feb 27 12:36:24 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "cinder-ce7bd662-04a9-4610-b342-d2c794cbbf6f-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-ce7bd662-04a9-4610-b342-d2c794cbbf6f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "cinder-quobyte-ce7bd662-04a9-4610-b342-d2c794cbbf6f" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-quobyte-ce7bd662-04a9-4610-b342-d2c794cbbf6f" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a7a653-20cd-4590-a549-1cf16521df19]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:24 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f Feb 27 12:36:24 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:24 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0" returned: 0 in 0.471s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457b1ead-547c-4d0b-afd1-4671503a23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69726585-da62-4bbd-a5cb-f1e90d0a290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:24 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Volume volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 (02b35296-cdfe-42be-8cf3-23cbf8728dc0): created successfully Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69726585-da62-4bbd-a5cb-f1e90d0a290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (16963aea-e724-464d-b8a0-03b3596b1038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:24 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-570ba6b4-0a97-44b2-b12f-faa91d724e22 tempest-VolumesGetTest-442158571 None] Created volume successfully. Feb 27 12:36:25 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f" returned: 0 in 0.452s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:25 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f Feb 27 12:36:25 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:25 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ce7bd662-04a9-4610-b342-d2c794cbbf6f" returned: 0 in 0.437s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-quobyte-ce7bd662-04a9-4610-b342-d2c794cbbf6f" released by "delete_volume" :: held 0.920s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Created reservations ['dce0ad49-841d-45b2-a81f-a2e960a5a4fa', '0f7aca6b-dcf8-4d35-960a-44a9ba81bfd4', '11b14494-6592-4a0b-a323-32a535aaade0', 'd0d5db0b-9236-4980-923c-37d42edd0398'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:25 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:25 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:26 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.477s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:26 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Deleted volume successfully. Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-954a0a37-a6cf-4f44-8fdd-0c3bca58c446 tempest-VolumesTestJSON-1104664905 None] Lock "cinder-ce7bd662-04a9-4610-b342-d2c794cbbf6f-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (e4ecac0e-e446-45d6-a76d-eac010aa7e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31e82f5-ba28-4d42-8418-3f7139638130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31e82f5-ba28-4d42-8418-3f7139638130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-305932793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c657851c-2adc-4771-939e-2c6014131a51,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=02b35296-cdfe-42be-8cf3-23cbf8728dc0,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:26Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55af2a51-4172-4af2-b616-c27752061cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55af2a51-4172-4af2-b616-c27752061cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573b6976-af10-4630-ab91-3efbae3aa405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573b6976-af10-4630-ab91-3efbae3aa405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c657851c-2adc-4771-939e-2c6014131a51', 'volume_name': 'volume-c657851c-2adc-4771-939e-2c6014131a51', 'volume_size': 1, 'source_volid': '02b35296-cdfe-42be-8cf3-23cbf8728dc0', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb598fd4-7fbe-4ba9-9d8a-248baf548a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb598fd4-7fbe-4ba9-9d8a-248baf548a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7ae5e4-0278-4e5c-b4db-cd78dfaef844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:26 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Volume c657851c-2adc-4771-939e-2c6014131a51: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c657851c-2adc-4771-939e-2c6014131a51', 'volume_size': 1, 'source_volid': '02b35296-cdfe-42be-8cf3-23cbf8728dc0', 'source_volstatus': 'available'} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:26 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Cloning volume 02b35296-cdfe-42be-8cf3-23cbf8728dc0 to volume c657851c-2adc-4771-939e-2c6014131a51 Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Creating offline snapshot c6d7ab34-7f51-4dca-932c-87099d0557ec of volume 02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d474b7-451e-46d9-b92a-873e341a3517]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:26 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 Feb 27 12:36:26 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:26 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0" returned: 0 in 0.589s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:26 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec 1G Feb 27 12:36:26 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:27 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec 1G" returned: 0 in 0.563s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:27 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec Feb 27 12:36:27 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:27 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec" returned: 0 in 0.495s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:27 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec is being set with open permissions: ugo+rw Feb 27 12:36:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:27 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec Feb 27 12:36:27 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:28 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec" returned: 0 in 0.449s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:28 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.info Feb 27 12:36:28 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:28 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.info" returned: 0 in 0.502s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:28 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.info is being set with open permissions: ugo+rw Feb 27 12:36:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:28 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.info Feb 27 12:36:28 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:29 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.info" returned: 0 in 0.423s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-c657851c-2adc-4771-939e-2c6014131a51" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c657851c-2adc-4771-939e-2c6014131a51" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] snapshot: c6d7ab34-7f51-4dca-932c-87099d0557ec, volume: c657851c-2adc-4771-939e-2c6014131a51, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8599eb5-422e-4946-80bc-ab85cfad7055]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:29 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec Feb 27 12:36:29 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:29 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec" returned: 0 in 0.568s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1fe589-d616-4d91-af17-d31d32150b2f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:29 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 Feb 27 12:36:29 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:30 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0" returned: 0 in 0.607s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:30 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:36:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:30 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 Feb 27 12:36:30 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:32 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51" returned: 0 in 2.292s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:32 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c8a5e-58e5-4770-984a-d8b946271a43]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:32 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 Feb 27 12:36:32 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:33 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0" returned: 0 in 0.661s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:36:33 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Converted 1024.00 MB image at 446.36 MB/s Feb 27 12:36:33 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 is being set with open permissions: ugo+rw Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:33 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 Feb 27 12:36:33 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:33 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51" returned: 0 in 0.417s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c657851c-2adc-4771-939e-2c6014131a51" released by "_copy_volume_from_snapshot" :: held 4.598s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-c6d7ab34-7f51-4dca-932c-87099d0557ec" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c6d7ab34-7f51-4dca-932c-87099d0557ec" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Deleting offline snapshot c6d7ab34-7f51-4dca-932c-87099d0557ec of volume 02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] snapshot_file for this snap is: volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaec89f-dd04-4e13-bc07-77caf5e8c3f2]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:33 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec Feb 27 12:36:33 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:34 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec" returned: 0 in 0.534s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:36:34 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610635c-b262-4a97-98df-95b8256f8044]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:34 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 Feb 27 12:36:34 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:34 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0" returned: 0 in 0.502s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:34 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec Feb 27 12:36:34 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:35 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec" returned: 0 in 0.512s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:35 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec Feb 27 12:36:35 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:35 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0.c6d7ab34-7f51-4dca-932c-87099d0557ec" returned: 0 in 0.449s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c6d7ab34-7f51-4dca-932c-87099d0557ec" released by "_delete_snapshot" :: held 2.044s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.782s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7ae5e4-0278-4e5c-b4db-cd78dfaef844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c657851c-2adc-4771-939e-2c6014131a51', 'volume_size': 1, 'source_volid': '02b35296-cdfe-42be-8cf3-23cbf8728dc0', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51abe2a3-8b65-4543-ad85-f106184b8c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:35 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Volume volume-c657851c-2adc-4771-939e-2c6014131a51 (c657851c-2adc-4771-939e-2c6014131a51): created successfully Feb 27 12:36:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51abe2a3-8b65-4543-ad85-f106184b8c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (e4ecac0e-e446-45d6-a76d-eac010aa7e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:36 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-614b94e4-ffe7-44af-b29f-ee7a016e2dc5 tempest-VolumesGetTest-442158571 None] Created volume successfully. Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (5199421a-c31e-407c-bf2a-abf78a41e127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfea938-a05c-4bb0-9101-4d8252cdca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfea938-a05c-4bb0-9101-4d8252cdca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-618215913',display_name='tempest-VolumesGetTest-Volume-1102763443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5646ab3-fa05-4279-b259-2c656daf2290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:37Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe561f-ab5e-4f26-a184-e35ed1132d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfe561f-ab5e-4f26-a184-e35ed1132d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f939d53-6b1c-419c-82ef-830287a8d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f939d53-6b1c-419c-82ef-830287a8d522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5646ab3-fa05-4279-b259-2c656daf2290', 'volume_name': 'volume-c5646ab3-fa05-4279-b259-2c656daf2290', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f02418c-4823-4f30-9ad5-c770410d3dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f02418c-4823-4f30-9ad5-c770410d3dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cda97b5-2e5e-426e-8557-e2be57d52c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:37 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Volume c5646ab3-fa05-4279-b259-2c656daf2290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5646ab3-fa05-4279-b259-2c656daf2290', 'volume_size': 1} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-618215913',display_name='tempest-VolumesGetTest-Volume-1102763443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5646ab3-fa05-4279-b259-2c656daf2290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:37Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Creating volume c5646ab3-fa05-4279-b259-2c656daf2290 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:37 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:37 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 1073741824 Feb 27 12:36:37 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:37 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 1073741824" returned: 0 in 0.514s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:37 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 Feb 27 12:36:37 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:38 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290" returned: 0 in 0.400s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cda97b5-2e5e-426e-8557-e2be57d52c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5646ab3-fa05-4279-b259-2c656daf2290', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14843b63-d232-4457-8ba6-953cba536ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:38 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Volume volume-c5646ab3-fa05-4279-b259-2c656daf2290 (c5646ab3-fa05-4279-b259-2c656daf2290): created successfully Feb 27 12:36:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14843b63-d232-4457-8ba6-953cba536ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (5199421a-c31e-407c-bf2a-abf78a41e127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:38 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-209e4c1a-827f-4959-879a-26a6b11d68f8 tempest-VolumesGetTest-442158571 None] Created volume successfully. Feb 27 12:36:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-c5646ab3-fa05-4279-b259-2c656daf2290-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Lock "cinder-c5646ab3-fa05-4279-b259-2c656daf2290-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-c5646ab3-fa05-4279-b259-2c656daf2290" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c5646ab3-fa05-4279-b259-2c656daf2290" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:39 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[05944707-64e3-4b6d-8f34-ed999ce3330d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:39 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 Feb 27 12:36:39 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:40 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290" returned: 0 in 0.573s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:40 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290 Feb 27 12:36:40 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:40 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c5646ab3-fa05-4279-b259-2c656daf2290" returned: 0 in 0.516s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c5646ab3-fa05-4279-b259-2c656daf2290" released by "delete_volume" :: held 1.114s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Created reservations ['8a077a77-f03a-4346-9d5b-13a3befd578e', '8f1e1b75-e0f7-4fca-ae62-8ec789e09955', 'c9405916-d22a-49b6-a6d6-8c78246a8713', '14ea0bbc-5d0a-4f36-895e-7810189fb414'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:40 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:40 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:41 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.490s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Deleted volume successfully. Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c9c81bc9-8ae2-4140-aef1-cfd66766db0b tempest-VolumesGetTest-442158571 None] Lock "cinder-c5646ab3-fa05-4279-b259-2c656daf2290-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-c657851c-2adc-4771-939e-2c6014131a51-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Lock "cinder-c657851c-2adc-4771-939e-2c6014131a51-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-c657851c-2adc-4771-939e-2c6014131a51" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c657851c-2adc-4771-939e-2c6014131a51" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae8083a-5712-4da7-9ca0-68199fa7e93f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:41 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 Feb 27 12:36:41 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:42 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51" returned: 0 in 0.522s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:42 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51 Feb 27 12:36:42 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:42 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c657851c-2adc-4771-939e-2c6014131a51" returned: 0 in 0.492s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c657851c-2adc-4771-939e-2c6014131a51" released by "delete_volume" :: held 1.039s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Created reservations ['38ea2dbd-ea3d-469f-abfd-96b5b34ff8a1', '3d7695c6-e4ac-494e-9397-8fc6bea4220a', 'd2b1d2de-49ba-4341-a849-a0bce2770c03', '652b0044-26f8-43bb-abad-e3c6956ee279'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:42 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:42 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:43 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.495s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Deleted volume successfully. Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-48238652-e638-4baa-8360-ba44e4dd5a42 tempest-VolumesGetTest-442158571 None] Lock "cinder-c657851c-2adc-4771-939e-2c6014131a51-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-02b35296-cdfe-42be-8cf3-23cbf8728dc0-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Lock "cinder-02b35296-cdfe-42be-8cf3-23cbf8728dc0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-02b35296-cdfe-42be-8cf3-23cbf8728dc0" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-02b35296-cdfe-42be-8cf3-23cbf8728dc0" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54db1cc-6068-4a79-8bd0-b0403e556c30]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:44 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 Feb 27 12:36:44 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:44 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0" returned: 0 in 0.517s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:44 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0 Feb 27 12:36:44 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:44 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-02b35296-cdfe-42be-8cf3-23cbf8728dc0" returned: 0 in 0.443s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-02b35296-cdfe-42be-8cf3-23cbf8728dc0" released by "delete_volume" :: held 0.996s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Created reservations ['d1e0590f-b2c3-475c-b274-399bd00ab0f0', '7f188881-528b-45c8-bf28-f7d4afa3350b', 'd1a5861d-33aa-42e6-8055-f9f817aae397', '9b5ee37b-ead3-4805-be05-f753113ec8c1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:44 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:44 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:45 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.455s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:45 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:45 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Deleted volume successfully. Feb 27 12:36:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-71d9d99c-812b-4227-b19d-619b645379cb tempest-VolumesGetTest-442158571 None] Lock "cinder-02b35296-cdfe-42be-8cf3-23cbf8728dc0-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (9e9ff723-43b1-4b7a-852f-7ad29987975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9a2261-bb38-4e43-87d9-b39b44bbba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9a2261-bb38-4e43-87d9-b39b44bbba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-60151160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e11756-19fa-4390-bd7c-1857b8801b7d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:46Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5454a7-7ad8-447e-8a21-084b1782dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc5454a7-7ad8-447e-8a21-084b1782dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade11b3e-1c9f-4126-88c9-4741b4e22ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.image.glance [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Creating Keystone auth plugin from conf {{(pid=83114) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade11b3e-1c9f-4126-88c9-4741b4e22ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1e11756-19fa-4390-bd7c-1857b8801b7d', 'volume_name': 'volume-c1e11756-19fa-4390-bd7c-1857b8801b7d', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3c652c-8e92-44c6-bb0d-c8853de7e55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3c652c-8e92-44c6-bb0d-c8853de7e55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3fd9c0-bf8c-4640-a2e9-8a3eedcff6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:46 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Volume c1e11756-19fa-4390-bd7c-1857b8801b7d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1e11756-19fa-4390-bd7c-1857b8801b7d', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 12:36:46 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Trying to clone c1e11756-19fa-4390-bd7c-1857b8801b7d from image 449413c1-523c-4e99-abe8-e0bfc981c2bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]). {{(pid=83114) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 12:36:47 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 12:36:47 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Image download 20.69 MB at 20.69 MB/s Feb 27 12:36:47 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d721e47f-6541-4667-8de7-1ccfbae32e06]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:47 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD Feb 27 12:36:47 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:47 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:47 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc is fetched for user e9a6aa56e27f41e4874609ae6497a27a. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 12:36:47 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[595f0626-eafe-4c6d-b8c9-6047011e6a19]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:47 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD Feb 27 12:36:47 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:48 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-60151160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e11756-19fa-4390-bd7c-1857b8801b7d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:46Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Creating volume c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:48 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:48 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d 1073741824 Feb 27 12:36:48 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:48 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d 1073741824" returned: 0 in 0.526s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:48 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d Feb 27 12:36:48 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:49 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d" returned: 0 in 0.549s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Attempting download of 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume c1e11756-19fa-4390-bd7c-1857b8801b7d. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ba3b1b-229f-42c4-8c62-1f5a3ef23bbe]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ybxw8r85 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:49 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ybxw8r85 Feb 27 12:36:49 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:49 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ybxw8r85" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ybxw8r85 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:49 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ybxw8r85 Feb 27 12:36:49 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:50 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ybxw8r85" returned: 1 in 0.500s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_449413c1-523c-4e99-abe8-e0bfc981c2bc_ybxw8r85' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:36:50 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef45fd-be28-4ec8-b7a3-45f360eabaeb]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:50 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD Feb 27 12:36:50 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:50 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:50 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] 449413c1-523c-4e99-abe8-e0bfc981c2bc was qcow2, converting to raw {{(pid=83114) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 12:36:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:50 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d Feb 27 12:36:50 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:51 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d" returned: 0 in 1.059s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:51 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_449413c1-523c-4e99-abe8-e0bfc981c2bc_6rgn4msxdevstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:36:51 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Converted 112.00 MB image at 105.66 MB/s Feb 27 12:36:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:51 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d 1G Feb 27 12:36:51 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:52 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d 1G" returned: 0 in 0.435s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:52 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2289110-a62c-41fe-a31e-30fd86ef048a]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:52 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d Feb 27 12:36:52 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:52 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d" returned: 0 in 0.576s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:53 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d Feb 27 12:36:53 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:53 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d" returned: 1 in 0.555s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Downloaded image 449413c1-523c-4e99-abe8-e0bfc981c2bc ((None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}])) to volume c1e11756-19fa-4390-bd7c-1857b8801b7d successfully. {{(pid=83114) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Temporary image 449413c1-523c-4e99-abe8-e0bfc981c2bc for user e9a6aa56e27f41e4874609ae6497a27a is deleted. {{(pid=83114) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.volume_utils [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Marking volume c1e11756-19fa-4390-bd7c-1857b8801b7d as bootable. {{(pid=83114) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Copying metadata from image 449413c1-523c-4e99-abe8-e0bfc981c2bc to c1e11756-19fa-4390-bd7c-1857b8801b7d. {{(pid=83114) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Creating volume glance metadata for volume c1e11756-19fa-4390-bd7c-1857b8801b7d backed by image 449413c1-523c-4e99-abe8-e0bfc981c2bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83114) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3fd9c0-bf8c-4640-a2e9-8a3eedcff6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e11756-19fa-4390-bd7c-1857b8801b7d', 'volume_size': 1, 'image_id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/449413c1-523c-4e99-abe8-e0bfc981c2bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7e47d504c3945f4be81bb8ac1384c92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '449413c1-523c-4e99-abe8-e0bfc981c2bc', 'created_at': datetime.datetime(2026, 2, 27, 11, 24, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 11, 24, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/449413c1-523c-4e99-abe8-e0bfc981c2bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6ab39a-e15d-44e0-9083-9c8c0b045640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:53 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Volume volume-c1e11756-19fa-4390-bd7c-1857b8801b7d (c1e11756-19fa-4390-bd7c-1857b8801b7d): created successfully Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6ab39a-e15d-44e0-9083-9c8c0b045640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (9e9ff723-43b1-4b7a-852f-7ad29987975e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:53 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3c7942e1-35da-49b6-b58e-4e73814e530a tempest-VolumesGetTest-442158571 None] Created volume successfully. Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (c4050ed1-8617-4bfa-844a-90896879fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8172e2dc-bcd6-420d-a663-2d7ab60a3051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8172e2dc-bcd6-420d-a663-2d7ab60a3051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2015581538',display_name='tempest-VolumesGetTest-Volume-779856036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7453f129-e506-4678-b96c-7e804e77badb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01a3a59-6378-4a6c-ba0c-6e619048b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01a3a59-6378-4a6c-ba0c-6e619048b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dce304-fe68-47d3-aae5-330fd43ab692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dce304-fe68-47d3-aae5-330fd43ab692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7453f129-e506-4678-b96c-7e804e77badb', 'volume_name': 'volume-7453f129-e506-4678-b96c-7e804e77badb', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d63aaa-8eaa-45cd-9e82-974717b012a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d63aaa-8eaa-45cd-9e82-974717b012a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16d16f6-81e6-4294-b2f9-d3f96cdce81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:54 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Volume 7453f129-e506-4678-b96c-7e804e77badb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7453f129-e506-4678-b96c-7e804e77badb', 'volume_size': 1} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:36:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2015581538',display_name='tempest-VolumesGetTest-Volume-779856036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7453f129-e506-4678-b96c-7e804e77badb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218a2f1d17e843b6a534a6440dbc0d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:36:54Z,use_quota=True,user_id='e9a6aa56e27f41e4874609ae6497a27a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Creating volume 7453f129-e506-4678-b96c-7e804e77badb {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:36:54 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:54 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb 1073741824 Feb 27 12:36:54 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:54 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb 1073741824" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:54 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb Feb 27 12:36:54 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:55 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb" returned: 0 in 0.404s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:36:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16d16f6-81e6-4294-b2f9-d3f96cdce81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7453f129-e506-4678-b96c-7e804e77badb', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5d34e0-9a86-4942-9778-bf19521cc31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:36:55 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Volume volume-7453f129-e506-4678-b96c-7e804e77badb (7453f129-e506-4678-b96c-7e804e77badb): created successfully Feb 27 12:36:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5d34e0-9a86-4942-9778-bf19521cc31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:36:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Flow 'volume_create_manager' (c4050ed1-8617-4bfa-844a-90896879fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:36:55 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c4ff1c17-cab4-4f2d-9b78-ea61c00af458 tempest-VolumesGetTest-442158571 None] Created volume successfully. Feb 27 12:36:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-7453f129-e506-4678-b96c-7e804e77badb-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Lock "cinder-7453f129-e506-4678-b96c-7e804e77badb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-7453f129-e506-4678-b96c-7e804e77badb" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-7453f129-e506-4678-b96c-7e804e77badb" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:56 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b689bd-b171-4d41-9289-16f0d8dbd064]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:56 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb Feb 27 12:36:56 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:57 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:57 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb Feb 27 12:36:57 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:57 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7453f129-e506-4678-b96c-7e804e77badb" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-7453f129-e506-4678-b96c-7e804e77badb" released by "delete_volume" :: held 0.944s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Created reservations ['2fa24cee-4773-464d-92fd-d60036d6ce41', '4c1f368b-592c-4a8d-ae21-f69110f88375', '54be5593-1963-4842-baac-d4253637a32c', '772df851-1fd3-41e4-9fa6-2bfb57861459'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:57 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:57 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-c1e11756-19fa-4390-bd7c-1857b8801b7d-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Lock "cinder-c1e11756-19fa-4390-bd7c-1857b8801b7d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Acquiring lock "cinder-quobyte-c1e11756-19fa-4390-bd7c-1857b8801b7d" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c1e11756-19fa-4390-bd7c-1857b8801b7d" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a311768-e9e2-4b6c-94d4-5b5a8efec9da]: (4, 'raw') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:36:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:57 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d Feb 27 12:36:57 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Deleted volume successfully. Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5f95004e-ebd4-45f7-8c67-c5e321d0b9cc tempest-VolumesGetTest-442158571 None] Lock "cinder-7453f129-e506-4678-b96c-7e804e77badb-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:58 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d" returned: 0 in 0.582s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:58 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d Feb 27 12:36:58 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:58 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d" returned: 1 in 0.491s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d' failed. Not Retrying. {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 12:36:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:58 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d Feb 27 12:36:58 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:59 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-c1e11756-19fa-4390-bd7c-1857b8801b7d" returned: 0 in 0.437s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Lock "cinder-quobyte-c1e11756-19fa-4390-bd7c-1857b8801b7d" released by "delete_volume" :: held 1.560s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Created reservations ['b1769c51-8e3c-4b48-9c30-7ad7283b2ecf', '85bf6836-c602-4a13-998b-0f9c1c538895', 'fc81cf93-38ef-4437-b13c-8b3cfe939ae7', 'f84bf567-11a5-4dbb-b30b-463d98bc300b'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:36:59 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:36:59 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:36:59 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.412s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:36:59 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Deleted volume successfully. Feb 27 12:36:59 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8ec5e001-73cf-42ef-af07-cbcf02955c16 tempest-VolumesGetTest-442158571 None] Lock "cinder-c1e11756-19fa-4390-bd7c-1857b8801b7d-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Flow 'volume_create_manager' (689f7153-c130-4b6b-8bc3-46d8e81588cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b4b872-d1e0-4348-a2d0-29cb36518edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b4b872-d1e0-4348-a2d0-29cb36518edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1696371418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e073d871-8486-4a4e-ac8d-87675249204b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844a458143ca40c4aff01b8bb3b4b7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:03Z,use_quota=True,user_id='3772572e521840d9b87903cb12c216d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8234d7b5-70f5-4de8-92a3-e91fb9ff3cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8234d7b5-70f5-4de8-92a3-e91fb9ff3cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b719f8-92b3-4500-ab1e-24e667d985d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b719f8-92b3-4500-ab1e-24e667d985d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e073d871-8486-4a4e-ac8d-87675249204b', 'volume_name': 'volume-e073d871-8486-4a4e-ac8d-87675249204b', 'volume_size': 2}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d16ca3-2c14-41a9-8e4e-0c1e4df4900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d16ca3-2c14-41a9-8e4e-0c1e4df4900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2483cfb7-d592-44ac-abd1-295898ba7349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:03 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Volume e073d871-8486-4a4e-ac8d-87675249204b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e073d871-8486-4a4e-ac8d-87675249204b', 'volume_size': 2} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1696371418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e073d871-8486-4a4e-ac8d-87675249204b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='844a458143ca40c4aff01b8bb3b4b7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:03Z,use_quota=True,user_id='3772572e521840d9b87903cb12c216d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Creating volume e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:03 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b 2147483648 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:03 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b 2147483648 Feb 27 12:37:03 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:04 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b 2147483648" returned: 0 in 0.567s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:04 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b Feb 27 12:37:04 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:04 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b" returned: 0 in 0.516s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2483cfb7-d592-44ac-abd1-295898ba7349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e073d871-8486-4a4e-ac8d-87675249204b', 'volume_size': 2}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9299d435-1843-482f-b513-8853d2ede64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:04 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Volume volume-e073d871-8486-4a4e-ac8d-87675249204b (e073d871-8486-4a4e-ac8d-87675249204b): created successfully Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9299d435-1843-482f-b513-8853d2ede64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:04 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Flow 'volume_create_manager' (689f7153-c130-4b6b-8bc3-46d8e81588cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:04 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2109a129-d69b-406b-b41d-e422b42c4468 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Created volume successfully. Feb 27 12:37:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Creating offline snapshot e0e54b20-f394-46fd-8ab7-255abbe51322 of volume e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:37:05 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[af19d36d-1882-40c4-ae5a-f33ec19d4359]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:05 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b Feb 27 12:37:05 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:06 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (48c0b6e9-5593-4964-bf47-f87043b0e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1150fd1-01a5-4a1f-86d6-d5405fbb3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1150fd1-01a5-4a1f-86d6-d5405fbb3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150630006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5782ad2-36a9-4c1a-b784-9e7877fa7f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac8c595-94f7-46ca-ba1a-d07054c60e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac8c595-94f7-46ca-ba1a-d07054c60e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d65eaca-adc5-40c3-8689-c8de79760411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d65eaca-adc5-40c3-8689-c8de79760411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5782ad2-36a9-4c1a-b784-9e7877fa7f4b', 'volume_name': 'volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94471030-4d79-4a53-bdb0-9eb8db5e3911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94471030-4d79-4a53-bdb0-9eb8db5e3911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d7f89-fde2-463c-af05-e1a3e9c839e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:06 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Volume e5782ad2-36a9-4c1a-b784-9e7877fa7f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b', 'volume_size': 1} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b" returned: 0 in 0.681s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 2G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:06 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 2G Feb 27 12:37:06 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:06 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 2G" returned: 0 in 0.572s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e073d871-8486-4a4e-ac8d-87675249204b -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:06 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e073d871-8486-4a4e-ac8d-87675249204b -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 Feb 27 12:37:06 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:07 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e073d871-8486-4a4e-ac8d-87675249204b -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322" returned: 0 in 0.510s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 is being set with open permissions: ugo+rw Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 Feb 27 12:37:07 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:07 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.499s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:07 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322" returned: 0 in 0.421s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:07 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.info Feb 27 12:37:07 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:08 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.info" returned: 0 in 0.410s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:08 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.info is being set with open permissions: ugo+rw Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:08 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.info Feb 27 12:37:08 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:08 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.info" returned: 0 in 0.454s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.114s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.423s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150630006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5782ad2-36a9-4c1a-b784-9e7877fa7f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:06Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Creating volume e5782ad2-36a9-4c1a-b784-9e7877fa7f4b {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:08 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:08 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b 1073741824 Feb 27 12:37:08 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-916a1202-9f7e-4ca4-8961-11b2c3d1d9ec tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Create snapshot completed successfully Feb 27 12:37:09 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b 1073741824" returned: 0 in 0.505s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:09 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b Feb 27 12:37:09 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:09 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" returned: 0 in 0.418s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d7f89-fde2-463c-af05-e1a3e9c839e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bb4e97-cdce-465c-b415-93fe6fc5e885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:09 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Volume volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b (e5782ad2-36a9-4c1a-b784-9e7877fa7f4b): created successfully Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bb4e97-cdce-465c-b415-93fe6fc5e885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (48c0b6e9-5593-4964-bf47-f87043b0e58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9a26cfe1-737b-4be9-a009-75a091d09d1a tempest-VolumesActionsTest-646854440 None] Created volume successfully. Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "cinder-e0e54b20-f394-46fd-8ab7-255abbe51322-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-e0e54b20-f394-46fd-8ab7-255abbe51322-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "cinder-quobyte-e073d871-8486-4a4e-ac8d-87675249204b" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-quobyte-e073d871-8486-4a4e-ac8d-87675249204b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "cinder-quobyte-e0e54b20-f394-46fd-8ab7-255abbe51322" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-quobyte-e0e54b20-f394-46fd-8ab7-255abbe51322" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Deleting offline snapshot e0e54b20-f394-46fd-8ab7-255abbe51322 of volume e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] snapshot_file for this snap is: volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8dd9e0-396d-47ae-8430-4e7fd9e81d06]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:09 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 Feb 27 12:37:09 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:10 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322" returned: 0 in 0.496s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e073d871-8486-4a4e-ac8d-87675249204b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefbebe-8da3-4cb6-863a-cce3c261b8ed]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:10 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b Feb 27 12:37:10 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7b59213e-dca9-4fb3-994d-81c5c86f0c61 tempest-VolumesActionsTest-646854440 None] Acquiring lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" by "attach_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7b59213e-dca9-4fb3-994d-81c5c86f0c61 tempest-VolumesActionsTest-646854440 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" acquired by "attach_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=117,cinder:INSERT=40,cinder:UPDATE=158,cinder:DELETE=12 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=119,cinder:INSERT=50,cinder:UPDATE=156,cinder:DELETE=15 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:37:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-7b59213e-dca9-4fb3-994d-81c5c86f0c61 tempest-VolumesActionsTest-646854440 None] Attaching volume e5782ad2-36a9-4c1a-b784-9e7877fa7f4b to instance 3254f78f-1846-4706-9759-8d13cdf67c71 at mountpoint /dev/vdb on host None. Feb 27 12:37:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-7b59213e-dca9-4fb3-994d-81c5c86f0c61 tempest-VolumesActionsTest-646854440 None] Attach volume completed successfully. Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-7b59213e-dca9-4fb3-994d-81c5c86f0c61 tempest-VolumesActionsTest-646854440 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" released by "attach_volume" :: held 0.076s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:10 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:10 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 Feb 27 12:37:10 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8eadf718-e09a-4822-8c26-23d8f8dfb37a tempest-VolumesActionsTest-2090897105 None] Terminate volume connection completed successfully. Feb 27 12:37:11 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322" returned: 0 in 0.557s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:11 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322 Feb 27 12:37:11 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:11 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b.e0e54b20-f394-46fd-8ab7-255abbe51322" returned: 0 in 0.421s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-quobyte-e0e54b20-f394-46fd-8ab7-255abbe51322" released by "_delete_snapshot" :: held 2.043s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8eadf718-e09a-4822-8c26-23d8f8dfb37a tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-detach_volume" by "detach_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-quobyte-e073d871-8486-4a4e-ac8d-87675249204b" released by "delete_snapshot" :: held 2.064s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8eadf718-e09a-4822-8c26-23d8f8dfb37a tempest-VolumesActionsTest-2090897105 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8eadf718-e09a-4822-8c26-23d8f8dfb37a tempest-VolumesActionsTest-2090897105 None] Detaching volume e5782ad2-36a9-4c1a-b784-9e7877fa7f4b from instance 3254f78f-1846-4706-9759-8d13cdf67c71. Feb 27 12:37:12 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Created reservations ['7c4accbd-dcee-40d3-aea0-9870c08b894c', '15da3ad9-642b-4172-8eaf-30beda69e8f8', '6158954a-0d7d-4475-a1e4-64469e9b12ff', '8c04d43e-c818-4176-a3cd-28c575f199aa'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8eadf718-e09a-4822-8c26-23d8f8dfb37a tempest-VolumesActionsTest-2090897105 None] Detach volume completed successfully. Feb 27 12:37:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8eadf718-e09a-4822-8c26-23d8f8dfb37a tempest-VolumesActionsTest-2090897105 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Delete snapshot completed successfully. Feb 27 12:37:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8dd07acb-aa76-444a-a460-9f127e69394f tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-e0e54b20-f394-46fd-8ab7-255abbe51322-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-299a1bd9-ae27-4ec5-b712-d3cf8543b159 tempest-VolumesActionsTest-646854440 None] Acquiring lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-detach_volume" by "detach_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-299a1bd9-ae27-4ec5-b712-d3cf8543b159 tempest-VolumesActionsTest-646854440 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-299a1bd9-ae27-4ec5-b712-d3cf8543b159 tempest-VolumesActionsTest-646854440 None] Volume detach called, but volume not attached. Feb 27 12:37:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-299a1bd9-ae27-4ec5-b712-d3cf8543b159 tempest-VolumesActionsTest-646854440 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-detach_volume" released by "detach_volume" :: held 0.016s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "cinder-e073d871-8486-4a4e-ac8d-87675249204b-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-e073d871-8486-4a4e-ac8d-87675249204b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "cinder-quobyte-e073d871-8486-4a4e-ac8d-87675249204b" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-quobyte-e073d871-8486-4a4e-ac8d-87675249204b" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e53fa5-b940-4def-ac1f-273ab42ef51e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Acquiring lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:13 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b Feb 27 12:37:13 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Acquiring lock "cinder-quobyte-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Lock "cinder-quobyte-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a884cd1-3aa1-4cf0-ab00-4d7d925c7824]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b Feb 27 12:37:13 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:13 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b" returned: 0 in 0.554s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b Feb 27 12:37:13 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:13 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" returned: 0 in 0.491s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:13 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b Feb 27 12:37:13 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:14 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e073d871-8486-4a4e-ac8d-87675249204b" returned: 0 in 0.413s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-quobyte-e073d871-8486-4a4e-ac8d-87675249204b" released by "delete_volume" :: held 1.005s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Created reservations ['3431195f-7313-42c5-946c-a9af3ac2dfdd', '5f75edba-c51f-4193-929e-1b1700d31937', 'c19d9581-b799-4ffc-90eb-94caf1cba183', 'f7770e20-eb99-4df5-a487-06687be3d07a'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:14 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" returned: 0 in 0.449s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Lock "cinder-quobyte-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b" released by "delete_volume" :: held 0.981s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:14 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:14 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Created reservations ['802c7cbe-d90f-498d-80b2-f8594358fd5e', 'cd149d86-f9ce-4257-ab09-19205e95e13c', 'e2d99839-5ea9-4b6b-940d-f706d3b2b290', 'c33dcbcc-36ad-46cb-bc8e-13aec6762705'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:14 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:14 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:14 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.466s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Deleted volume successfully. Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc7c4c7c-2618-49bf-be25-677f3157bbb6 tempest-VolumesSnapshotNegativeTestJSON-1524963625 None] Lock "cinder-e073d871-8486-4a4e-ac8d-87675249204b-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:14 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.449s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Deleted volume successfully. Feb 27 12:37:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6f60f13e-345a-4e21-89b5-f12d40e7f854 tempest-VolumesActionsTest-646854440 None] Lock "cinder-e5782ad2-36a9-4c1a-b784-9e7877fa7f4b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (d0ca2bb9-ab30-4244-abb1-8841d05dcb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8912e8-4194-401a-8807-75896356f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8912e8-4194-401a-8807-75896356f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556130376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dca720-d706-4a2a-a49e-1c9122bd5188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:18Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fbf2f5-0962-426a-9af7-fe9bbd3f548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fbf2f5-0962-426a-9af7-fe9bbd3f548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f90598b-589b-42c2-ae42-1ea3b58ac172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f90598b-589b-42c2-ae42-1ea3b58ac172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34dca720-d706-4a2a-a49e-1c9122bd5188', 'volume_name': 'volume-34dca720-d706-4a2a-a49e-1c9122bd5188', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae1d27-84d9-4f2e-a169-d31553625e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae1d27-84d9-4f2e-a169-d31553625e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fb9fa2-46c7-4fe1-80ae-07f5563741c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:17 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume 34dca720-d706-4a2a-a49e-1c9122bd5188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34dca720-d706-4a2a-a49e-1c9122bd5188', 'volume_size': 1} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556130376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dca720-d706-4a2a-a49e-1c9122bd5188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:18Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Creating volume 34dca720-d706-4a2a-a49e-1c9122bd5188 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:17 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:17 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 1073741824 Feb 27 12:37:17 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:18 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 1073741824" returned: 0 in 0.544s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:18 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 Feb 27 12:37:18 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:18 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188" returned: 0 in 0.459s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fb9fa2-46c7-4fe1-80ae-07f5563741c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34dca720-d706-4a2a-a49e-1c9122bd5188', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af4ff2-3b7c-4991-9daf-30b7e245314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume volume-34dca720-d706-4a2a-a49e-1c9122bd5188 (34dca720-d706-4a2a-a49e-1c9122bd5188): created successfully Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55af4ff2-3b7c-4991-9daf-30b7e245314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (d0ca2bb9-ab30-4244-abb1-8841d05dcb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:18 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1e5b01a4-afff-4509-be57-4a21d0ee1eb1 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created volume successfully. Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (d013d19b-bab7-48c2-9601-5ae3a8977307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4692dac-da3f-48b4-8d45-be9795841c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4692dac-da3f-48b4-8d45-be9795841c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1487596809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c05ec71-8421-49d9-a98b-269cd0e5b029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:20Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1594d1c-90e7-4b07-a166-ff7c6a8c3f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1594d1c-90e7-4b07-a166-ff7c6a8c3f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221f4521-86bd-4ebc-a4a2-dc578b1b004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221f4521-86bd-4ebc-a4a2-dc578b1b004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c05ec71-8421-49d9-a98b-269cd0e5b029', 'volume_name': 'volume-7c05ec71-8421-49d9-a98b-269cd0e5b029', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ece490a-c049-4218-975a-0946c3728cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ece490a-c049-4218-975a-0946c3728cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387ba108-b7db-4d34-b4db-e2f9af94d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume 7c05ec71-8421-49d9-a98b-269cd0e5b029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c05ec71-8421-49d9-a98b-269cd0e5b029', 'volume_size': 1} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1487596809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c05ec71-8421-49d9-a98b-269cd0e5b029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:20Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Creating volume 7c05ec71-8421-49d9-a98b-269cd0e5b029 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:20 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:20 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 1073741824 Feb 27 12:37:20 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (60d99fc4-1a6b-4f77-a75f-a0f6e68e86e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ead98-ff7c-4c7b-8d38-c8268bd7f2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998ead98-ff7c-4c7b-8d38-c8268bd7f2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862009362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a1c422-a61c-4ca2-a273-0b036388c22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:20Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87b0925-48e6-478f-aa9f-47c83f7ecce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87b0925-48e6-478f-aa9f-47c83f7ecce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cea505-c745-4980-82f8-844a9eab4583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cea505-c745-4980-82f8-844a9eab4583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a1c422-a61c-4ca2-a273-0b036388c22c', 'volume_name': 'volume-63a1c422-a61c-4ca2-a273-0b036388c22c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6752d5-d34c-4e2b-8286-a3238ebdb09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6752d5-d34c-4e2b-8286-a3238ebdb09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a42c94-0d61-4ad4-b244-02eb8b40d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume 63a1c422-a61c-4ca2-a273-0b036388c22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a1c422-a61c-4ca2-a273-0b036388c22c', 'volume_size': 1} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (b30317fb-0703-4a2e-b830-f5710d47cf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156e69a5-d8ce-40ff-927f-21656585fa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156e69a5-d8ce-40ff-927f-21656585fa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533878215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcedc1ec-cd42-4d2e-8e2e-2ca141066d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:20Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8be837-5a0e-40c3-8615-39062a4ebd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8be837-5a0e-40c3-8615-39062a4ebd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e504be-7ca6-4543-a950-a7d7b0ed388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e504be-7ca6-4543-a950-a7d7b0ed388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcedc1ec-cd42-4d2e-8e2e-2ca141066d15', 'volume_name': 'volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cbe4a5-66b1-444c-b26a-58b33d420088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54cbe4a5-66b1-444c-b26a-58b33d420088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc451bfd-3905-44c9-8f19-ca8b9b93cd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume dcedc1ec-cd42-4d2e-8e2e-2ca141066d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15', 'volume_size': 1} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (3542d740-361b-4923-99ef-dfff8c7716bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b7c546-6608-4e2d-a762-3fa33f3fd43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b7c546-6608-4e2d-a762-3fa33f3fd43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843656430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33471978-5165-404c-8580-a593a4e5a069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:21Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c000f911-1c4d-4738-bae0-6905c44110b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c000f911-1c4d-4738-bae0-6905c44110b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f454f0a3-c139-45d8-88ca-ea3894d35ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f454f0a3-c139-45d8-88ca-ea3894d35ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33471978-5165-404c-8580-a593a4e5a069', 'volume_name': 'volume-33471978-5165-404c-8580-a593a4e5a069', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc54b59e-3184-4b78-b55a-5993be61e489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc54b59e-3184-4b78-b55a-5993be61e489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9473fd2-97d4-4e30-aca3-32bb029699f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume 33471978-5165-404c-8580-a593a4e5a069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33471978-5165-404c-8580-a593a4e5a069', 'volume_size': 1} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:20 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 1073741824" returned: 0 in 0.719s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:20 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 Feb 27 12:37:20 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (25589b0e-34ea-441c-8a9d-96c2c79823db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db610fe1-9e9e-44a5-b788-c0c031dc595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db610fe1-9e9e-44a5-b788-c0c031dc595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752588068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:21Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f17a1e-dad0-485d-9159-4fcf81d716ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f17a1e-dad0-485d-9159-4fcf81d716ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0a4010-2fde-4c8c-9773-07a5ddef9fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0a4010-2fde-4c8c-9773-07a5ddef9fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c', 'volume_name': 'volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e04b2f-873b-4a47-8d34-07868d6a5787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e04b2f-873b-4a47-8d34-07868d6a5787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d992d662-3408-4090-86aa-d7950fbadde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume 142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c', 'volume_size': 1} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (a50cac06-177c-448d-956e-eedbee5db6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db11e8ea-1991-4ffa-9b66-cda8f34573c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db11e8ea-1991-4ffa-9b66-cda8f34573c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1336506841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637d9d3e-1126-4258-a419-ab177ff287e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:21Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372ec812-ef55-4218-b812-1d042e8912cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372ec812-ef55-4218-b812-1d042e8912cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0408204f-9380-46b4-a3c3-621921bf36ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0408204f-9380-46b4-a3c3-621921bf36ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637d9d3e-1126-4258-a419-ab177ff287e9', 'volume_name': 'volume-637d9d3e-1126-4258-a419-ab177ff287e9', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543b287c-2cb9-4470-b1b8-01b55fc6b89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (543b287c-2cb9-4470-b1b8-01b55fc6b89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f53de6-9b4e-47d3-83df-fb768c6c2a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Volume 637d9d3e-1126-4258-a419-ab177ff287e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637d9d3e-1126-4258-a419-ab177ff287e9', 'volume_size': 1} Feb 27 12:37:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:21 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029" returned: 0 in 0.492s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-862009362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a1c422-a61c-4ca2-a273-0b036388c22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:20Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Creating volume 63a1c422-a61c-4ca2-a273-0b036388c22c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:21 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387ba108-b7db-4d34-b4db-e2f9af94d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c05ec71-8421-49d9-a98b-269cd0e5b029', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa6ae8-206a-4de3-8e9b-5397145945a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:21 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c 1073741824 Feb 27 12:37:21 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 (7c05ec71-8421-49d9-a98b-269cd0e5b029): created successfully Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa6ae8-206a-4de3-8e9b-5397145945a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (d013d19b-bab7-48c2-9601-5ae3a8977307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-468b864c-a19e-4a3c-a2c2-7bb7cfd74ef6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created volume successfully. Feb 27 12:37:21 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c 1073741824" returned: 0 in 0.567s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:21 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c Feb 27 12:37:21 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:22 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c" returned: 0 in 0.450s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.920s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533878215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcedc1ec-cd42-4d2e-8e2e-2ca141066d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:20Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Creating volume dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:22 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a42c94-0d61-4ad4-b244-02eb8b40d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a1c422-a61c-4ca2-a273-0b036388c22c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71acd54d-3b63-445b-88c3-d8b96f6fffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:22 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 1073741824 Feb 27 12:37:22 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:22 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume volume-63a1c422-a61c-4ca2-a273-0b036388c22c (63a1c422-a61c-4ca2-a273-0b036388c22c): created successfully Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71acd54d-3b63-445b-88c3-d8b96f6fffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (60d99fc4-1a6b-4f77-a75f-a0f6e68e86e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:22 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3e24a982-fcb0-4640-aca1-f33038b89c95 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created volume successfully. Feb 27 12:37:22 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 1073741824" returned: 0 in 0.554s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:22 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 Feb 27 12:37:22 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:23 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15" returned: 0 in 0.473s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.715s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843656430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33471978-5165-404c-8580-a593a4e5a069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:21Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Creating volume 33471978-5165-404c-8580-a593a4e5a069 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:23 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc451bfd-3905-44c9-8f19-ca8b9b93cd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:23 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 1073741824 Feb 27 12:37:23 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6819bf-c4d4-4d1f-9634-b393e8004b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:23 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 (dcedc1ec-cd42-4d2e-8e2e-2ca141066d15): created successfully Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6819bf-c4d4-4d1f-9634-b393e8004b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (b30317fb-0703-4a2e-b830-f5710d47cf04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:23 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9b296b13-687b-4886-bfc6-7cbd6ad0f50b tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created volume successfully. Feb 27 12:37:23 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 1073741824" returned: 0 in 0.510s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:23 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 Feb 27 12:37:23 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:24 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069" returned: 0 in 0.502s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.548s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752588068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434b10c68b9e434287f9612cd2dd29f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:21Z,use_quota=True,user_id='60c43ceec4934657ac2e5b5fa3ad653e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Creating volume 142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:24 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9473fd2-97d4-4e30-aca3-32bb029699f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33471978-5165-404c-8580-a593a4e5a069', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:24 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c 1073741824 Feb 27 12:37:24 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158afed0-3eea-4d07-9021-28f5e19d82ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:24 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume volume-33471978-5165-404c-8580-a593a4e5a069 (33471978-5165-404c-8580-a593a4e5a069): created successfully Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158afed0-3eea-4d07-9021-28f5e19d82ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (3542d740-361b-4923-99ef-dfff8c7716bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:24 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b4f11d87-56b1-411a-a722-48709d80e984 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created volume successfully. Feb 27 12:37:24 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c 1073741824" returned: 0 in 0.553s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:25 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c Feb 27 12:37:25 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:25 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c" returned: 0 in 0.442s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.491s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1336506841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637d9d3e-1126-4258-a419-ab177ff287e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:21Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Creating volume 637d9d3e-1126-4258-a419-ab177ff287e9 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:25 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d992d662-3408-4090-86aa-d7950fbadde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5c608-677d-4827-80bf-2c52955229f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:25 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 1073741824 Feb 27 12:37:25 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:25 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Volume volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c (142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c): created successfully Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5c608-677d-4827-80bf-2c52955229f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Flow 'volume_create_manager' (25589b0e-34ea-441c-8a9d-96c2c79823db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:25 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-40be4a22-2a7a-4c07-bc40-159fae140659 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created volume successfully. Feb 27 12:37:25 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 1073741824" returned: 0 in 0.496s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:26 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 Feb 27 12:37:26 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-quobyte-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6daa71d-d5ee-4ac4-82c1-a403ac4f6859]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:26 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9" returned: 0 in 0.427s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f53de6-9b4e-47d3-83df-fb768c6c2a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637d9d3e-1126-4258-a419-ab177ff287e9', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd29ef5-60dd-442c-8261-d1133a4cb40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:26 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Volume volume-637d9d3e-1126-4258-a419-ab177ff287e9 (637d9d3e-1126-4258-a419-ab177ff287e9): created successfully Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd29ef5-60dd-442c-8261-d1133a4cb40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (a50cac06-177c-448d-956e-eedbee5db6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:26 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0ef7ccbf-4e40-44c3-b2d5-247ce3562831 tempest-VolumesActionsTest-646854440 None] Created volume successfully. Feb 27 12:37:26 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c Feb 27 12:37:26 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:26 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c" returned: 0 in 0.501s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:26 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c Feb 27 12:37:26 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c" returned: 0 in 0.398s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c" released by "delete_volume" :: held 0.923s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created reservations ['4ec63806-fdf4-45cb-b12e-0984f0bd5ec7', 'd6787808-b10f-4c2c-97c8-2afce10bd29f', 'f53210be-59ee-433c-b994-7588488ce812', '21187632-f48f-4ae4-907a-5290eb8e72f2'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:27 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-637d9d3e-1126-4258-a419-ab177ff287e9-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-33471978-5165-404c-8580-a593a4e5a069-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-33471978-5165-404c-8580-a593a4e5a069-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Lock "cinder-637d9d3e-1126-4258-a419-ab177ff287e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-quobyte-637d9d3e-1126-4258-a419-ab177ff287e9" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-637d9d3e-1126-4258-a419-ab177ff287e9" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-quobyte-33471978-5165-404c-8580-a593a4e5a069" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d078843c-49de-4710-9f2c-780b98b71552]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-33471978-5165-404c-8580-a593a4e5a069" acquired by "delete_volume" :: waited 0.019s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9351f-006c-45b4-b6bd-72e828261d88]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:27 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 Feb 27 12:37:27 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 Feb 27 12:37:27 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:27 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.448s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:27 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Deleted volume successfully. Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1daae990-3b9c-419e-988d-c89ddae35618 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-142d8a7c-e6e0-4b0d-9adf-03da5c3a6c6c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:27 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069" returned: 0 in 0.455s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:28 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069 Feb 27 12:37:28 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:28 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9 Feb 27 12:37:28 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:28 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-637d9d3e-1126-4258-a419-ab177ff287e9" returned: 0 in 0.390s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-637d9d3e-1126-4258-a419-ab177ff287e9" released by "delete_volume" :: held 0.917s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:28 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Created reservations ['3880e400-c098-4edc-9588-a27449ffafa6', 'd15936a9-96e7-4ffb-a6ec-114842fcdde7', 'ac1faeca-570d-4723-a146-609328815069', '980bef77-756f-4707-847e-6b8110ea4fa9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-33471978-5165-404c-8580-a593a4e5a069" returned: 0 in 0.464s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-33471978-5165-404c-8580-a593a4e5a069" released by "delete_volume" :: held 0.950s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created reservations ['58fa1f09-3b64-41f4-9b11-d8a1ad26219e', '4ec105c1-2ed4-46a5-b04d-9a2ade13a1ce', '4be633cb-797c-43e8-bd9e-5207178680fb', '25428a09-bdd3-4d27-8e71-8b57429ca492'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:28 devstack sudo[89857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:28 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:28 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:28 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (c03faa8f-f770-4518-9d25-aca43465b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1eb605-cf04-418a-94d8-deefa0dba877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1eb605-cf04-418a-94d8-deefa0dba877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985657216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac4b9c4-e794-4eb2-8799-e74261378c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:29Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9968c0a-d00c-415c-9c13-dfa2796f84d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9968c0a-d00c-415c-9c13-dfa2796f84d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4326c-3438-4e51-8151-2980ef173a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4326c-3438-4e51-8151-2980ef173a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bac4b9c4-e794-4eb2-8799-e74261378c67', 'volume_name': 'volume-bac4b9c4-e794-4eb2-8799-e74261378c67', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbec07c-f9ce-4af7-b396-15f2f2247194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbec07c-f9ce-4af7-b396-15f2f2247194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1033695e-b57e-46a2-ba09-f9458716e8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:28 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Volume bac4b9c4-e794-4eb2-8799-e74261378c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bac4b9c4-e794-4eb2-8799-e74261378c67', 'volume_size': 1} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985657216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac4b9c4-e794-4eb2-8799-e74261378c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:29Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Creating volume bac4b9c4-e794-4eb2-8799-e74261378c67 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:28 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:28 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 1073741824 Feb 27 12:37:28 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:28 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.460s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:28 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:28 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Deleted volume successfully. Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-494a5f43-8cad-43a8-bb75-85b73d887830 tempest-VolumesActionsTest-2090897105 None] Lock "cinder-637d9d3e-1126-4258-a419-ab177ff287e9-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:29 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.493s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Deleted volume successfully. Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-938d7b2a-b5b1-4a7f-aacb-7d7ecf4d1c4d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-33471978-5165-404c-8580-a593a4e5a069-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:29 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 1073741824" returned: 0 in 0.506s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:29 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 Feb 27 12:37:29 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-quobyte-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e6ad18-f998-475f-a6ad-26fbeb9f55bd]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:29 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 Feb 27 12:37:29 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:29 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67" returned: 0 in 0.423s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1033695e-b57e-46a2-ba09-f9458716e8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac4b9c4-e794-4eb2-8799-e74261378c67', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25a0e0c-41ad-4f05-8aeb-58bea3d25f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:29 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Volume volume-bac4b9c4-e794-4eb2-8799-e74261378c67 (bac4b9c4-e794-4eb2-8799-e74261378c67): created successfully Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25a0e0c-41ad-4f05-8aeb-58bea3d25f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (c03faa8f-f770-4518-9d25-aca43465b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-60b00485-d845-4ded-bbab-b3d6688bdbe1 tempest-VolumesActionsTest-646854440 None] Created volume successfully. Feb 27 12:37:30 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15" returned: 0 in 0.500s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:30 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15 Feb 27 12:37:30 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:30 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15" returned: 0 in 0.397s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15" released by "delete_volume" :: held 0.933s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created reservations ['90b5627b-35f1-40be-867d-3ccfd9e5306f', '1deda450-8088-4c5d-a53d-a7afa02e3d98', 'fc1a7106-e735-424f-9353-41aca15303d6', '10806774-eabe-4305-b4d5-e373a574792f'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:30 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:30 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-63a1c422-a61c-4ca2-a273-0b036388c22c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-63a1c422-a61c-4ca2-a273-0b036388c22c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-quobyte-63a1c422-a61c-4ca2-a273-0b036388c22c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-63a1c422-a61c-4ca2-a273-0b036388c22c" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae2cff-2b8f-4391-9ad4-b63fd449bfec]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:30 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c Feb 27 12:37:30 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-bac4b9c4-e794-4eb2-8799-e74261378c67-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Lock "cinder-bac4b9c4-e794-4eb2-8799-e74261378c67-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-quobyte-bac4b9c4-e794-4eb2-8799-e74261378c67" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-bac4b9c4-e794-4eb2-8799-e74261378c67" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[422e8b4e-79c3-4d6e-8e83-8b3939569e93]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:31 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.487s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:31 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Deleted volume successfully. Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-4d0fdc8e-9715-484a-ac9f-e516881e42e6 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-dcedc1ec-cd42-4d2e-8e2e-2ca141066d15-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:31 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 Feb 27 12:37:31 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c" returned: 0 in 0.534s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:31 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c Feb 27 12:37:31 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67" returned: 0 in 0.499s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:31 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67 Feb 27 12:37:31 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63a1c422-a61c-4ca2-a273-0b036388c22c" returned: 0 in 0.416s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-63a1c422-a61c-4ca2-a273-0b036388c22c" released by "delete_volume" :: held 0.984s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created reservations ['15c9b720-7bfc-4f5d-a8d3-aeda1ab9ffe3', 'e8c9a0ce-e34e-4a09-8a2e-8acb1cd186c2', 'a1056393-dc2e-4713-904e-5448fa942a25', '34b96a40-3353-475a-8123-4d79f1ffe37f'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:31 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:31 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-7c05ec71-8421-49d9-a98b-269cd0e5b029-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-7c05ec71-8421-49d9-a98b-269cd0e5b029-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-quobyte-7c05ec71-8421-49d9-a98b-269cd0e5b029" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-7c05ec71-8421-49d9-a98b-269cd0e5b029" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f74b02d-3546-4b6d-b89a-5703f1fdbdd5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 Feb 27 12:37:32 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:32 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-bac4b9c4-e794-4eb2-8799-e74261378c67" returned: 0 in 0.446s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-bac4b9c4-e794-4eb2-8799-e74261378c67" released by "delete_volume" :: held 0.969s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Created reservations ['f6038d18-9a37-4daa-981a-8c750a077a05', '3146d495-d785-411e-877f-b17cf2f82dcb', 'cee74b8b-f96a-44b3-88ef-eebc3e50d741', '74b9610c-b78f-4801-b29c-a642b002f2fe'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:32 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:32 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.437s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:32 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Deleted volume successfully. Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0edfac82-e1e6-4bf6-aea3-44182e70902d tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-63a1c422-a61c-4ca2-a273-0b036388c22c-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:32 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029" returned: 0 in 0.512s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029 Feb 27 12:37:32 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:32 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.410s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:32 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Deleted volume successfully. Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a7aa794d-5cff-4e45-9207-26989d0590fd tempest-VolumesActionsTest-2090897105 None] Lock "cinder-bac4b9c4-e794-4eb2-8799-e74261378c67-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:32 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7c05ec71-8421-49d9-a98b-269cd0e5b029" returned: 0 in 0.410s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-7c05ec71-8421-49d9-a98b-269cd0e5b029" released by "delete_volume" :: held 0.953s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created reservations ['6d1bff3a-3801-42fb-8eb3-0c4403389d24', '170d2474-ba04-43e1-8d15-00a09d631f3f', '809b5472-0418-45f8-ab44-5bf923802fe4', '9119999a-078d-42c5-a9e3-8d657d712f1e'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:32 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:32 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-34dca720-d706-4a2a-a49e-1c9122bd5188-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-34dca720-d706-4a2a-a49e-1c9122bd5188-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "cinder-quobyte-34dca720-d706-4a2a-a49e-1c9122bd5188" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-34dca720-d706-4a2a-a49e-1c9122bd5188" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[55400d2a-bdd9-4c7b-9231-c4b2e144f668]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:33 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 Feb 27 12:37:33 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:33 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.439s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:33 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Deleted volume successfully. Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cd30aee5-0c10-40d8-9c0a-a017c7bf914a tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-7c05ec71-8421-49d9-a98b-269cd0e5b029-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (368be9ab-e68d-4d1f-a734-1464bbd76056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9680a99-476c-4486-b28d-836792c6ff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9680a99-476c-4486-b28d-836792c6ff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1848380787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4781cf87-ca41-4171-aac2-aa452576a9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:33Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b21fedd-d4b3-48cf-a04c-0b24871821d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b21fedd-d4b3-48cf-a04c-0b24871821d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99490cb-d1ea-4e85-bf61-21f3be9df4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99490cb-d1ea-4e85-bf61-21f3be9df4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4781cf87-ca41-4171-aac2-aa452576a9e4', 'volume_name': 'volume-4781cf87-ca41-4171-aac2-aa452576a9e4', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5bb115-be5e-4606-9b19-a715bb4ed38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5bb115-be5e-4606-9b19-a715bb4ed38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca696094-dfcc-4f12-9de5-23cdb89cab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:33 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Volume 4781cf87-ca41-4171-aac2-aa452576a9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4781cf87-ca41-4171-aac2-aa452576a9e4', 'volume_size': 1} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1848380787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4781cf87-ca41-4171-aac2-aa452576a9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:33Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Creating volume 4781cf87-ca41-4171-aac2-aa452576a9e4 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:33 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:33 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 1073741824 Feb 27 12:37:33 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:33 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188" returned: 0 in 0.526s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:33 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188 Feb 27 12:37:33 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:34 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-34dca720-d706-4a2a-a49e-1c9122bd5188" returned: 0 in 0.424s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-quobyte-34dca720-d706-4a2a-a49e-1c9122bd5188" released by "delete_volume" :: held 0.972s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:34 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 1073741824" returned: 0 in 0.479s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Created reservations ['869a210d-321e-4d3e-8723-a4e324d91274', 'c07ce73a-57e8-4a48-92cd-f69f936ae68d', '9684e06b-df3b-4055-a71a-35b2074c2982', '27618194-9d3f-402f-b400-0af91922df70'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:34 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 Feb 27 12:37:34 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:34 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:34 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:34 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4" returned: 0 in 0.374s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca696094-dfcc-4f12-9de5-23cdb89cab4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4781cf87-ca41-4171-aac2-aa452576a9e4', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e892cf05-c5d8-4d8a-9d3f-efa33db7fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:34 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Volume volume-4781cf87-ca41-4171-aac2-aa452576a9e4 (4781cf87-ca41-4171-aac2-aa452576a9e4): created successfully Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e892cf05-c5d8-4d8a-9d3f-efa33db7fe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (368be9ab-e68d-4d1f-a734-1464bbd76056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-aaef5a65-8446-4db5-8aff-2954e393a985 tempest-VolumesActionsTest-646854440 None] Created volume successfully. Feb 27 12:37:34 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.407s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Deleted volume successfully. Feb 27 12:37:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a5166e47-b4a3-4e6a-b08b-5f837faa8061 tempest-CreateVolumesFromSourceVolumeTest-681042714 None] Lock "cinder-34dca720-d706-4a2a-a49e-1c9122bd5188-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-4781cf87-ca41-4171-aac2-aa452576a9e4-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Lock "cinder-4781cf87-ca41-4171-aac2-aa452576a9e4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-quobyte-4781cf87-ca41-4171-aac2-aa452576a9e4" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-4781cf87-ca41-4171-aac2-aa452576a9e4" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:35 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef6d19-d974-4fb3-a171-be198997294b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:35 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 Feb 27 12:37:35 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:36 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4" returned: 0 in 0.553s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:36 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4 Feb 27 12:37:36 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:36 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4781cf87-ca41-4171-aac2-aa452576a9e4" returned: 0 in 0.413s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-4781cf87-ca41-4171-aac2-aa452576a9e4" released by "delete_volume" :: held 0.991s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Created reservations ['bb687f7d-95b6-4562-9376-eae196034cd8', 'a9014fbd-6987-462f-84a5-37037383fdb6', '1a1318af-85b6-459e-93fc-2084841b172c', '9336b9bd-d6d3-4d7a-9984-d094ff00fa7c'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:36 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:36 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:37 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.432s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:37 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Deleted volume successfully. Feb 27 12:37:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-19f0a367-96f4-4e12-972a-619d798cf19d tempest-VolumesActionsTest-2090897105 None] Lock "cinder-4781cf87-ca41-4171-aac2-aa452576a9e4-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (d4e251f3-740e-4bcf-9d5a-752b3ed50326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1eb148-a030-4916-85d2-f3891e876b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1eb148-a030-4916-85d2-f3891e876b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1545913489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:38Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4107294-b6dc-4927-a001-9f93d7ef0426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4107294-b6dc-4927-a001-9f93d7ef0426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b002c46-a0b5-4703-abbf-f393b64ff4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b002c46-a0b5-4703-abbf-f393b64ff4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c', 'volume_name': 'volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441d4509-1534-40f8-950a-35902be468df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441d4509-1534-40f8-950a-35902be468df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efe2a3a-98ae-4ba9-aed0-7c6e43003dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:38 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Volume 50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c', 'volume_size': 1} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1545913489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:38Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Creating volume 50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:38 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:38 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c 1073741824 Feb 27 12:37:38 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:38 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c 1073741824" returned: 0 in 0.535s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:38 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c Feb 27 12:37:38 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:39 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c" returned: 0 in 0.429s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1efe2a3a-98ae-4ba9-aed0-7c6e43003dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b88ba3-021f-4eb4-ab97-9b62fd49fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:39 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Volume volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c (50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c): created successfully Feb 27 12:37:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b88ba3-021f-4eb4-ab97-9b62fd49fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:39 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (d4e251f3-740e-4bcf-9d5a-752b3ed50326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:39 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3f6a7991-a42e-4f39-b859-871d01f57184 tempest-VolumesActionsTest-646854440 None] Created volume successfully. Feb 27 12:37:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Lock "cinder-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Acquiring lock "cinder-quobyte-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:40 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c259684f-a8d8-4455-acb5-0bb88144ec9e]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:40 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c Feb 27 12:37:40 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:40 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c" returned: 0 in 0.483s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:41 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c Feb 27 12:37:41 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:41 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c" returned: 0 in 0.421s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Lock "cinder-quobyte-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c" released by "delete_volume" :: held 0.929s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Created reservations ['f007f35c-5627-4e7d-b515-d37db9a0c04c', 'ceedf870-4560-4010-8eba-82a7134d978e', '8d058c50-4162-4b79-bbc0-dc1e8c7538ae', 'c955e999-757a-4fc8-9ac0-fd4b256366d2'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:41 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:41 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (1173ae68-c522-40ed-a9bc-e51cc1b7f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4273d236-7095-48c9-8515-2833322a73ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4273d236-7095-48c9-8515-2833322a73ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1375093299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730bbca3-7fc7-491a-b949-5070a9a9b29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:42Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febc0642-5495-487d-b151-50b3f118e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febc0642-5495-487d-b151-50b3f118e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9da9b8-f7b1-4bac-98ea-54e496e25337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9da9b8-f7b1-4bac-98ea-54e496e25337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730bbca3-7fc7-491a-b949-5070a9a9b29c', 'volume_name': 'volume-730bbca3-7fc7-491a-b949-5070a9a9b29c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca8e318-ba7e-4803-a6d9-33a146297587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca8e318-ba7e-4803-a6d9-33a146297587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c319cfdd-40e5-493d-ac2c-1f6dbb55240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:41 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Volume 730bbca3-7fc7-491a-b949-5070a9a9b29c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730bbca3-7fc7-491a-b949-5070a9a9b29c', 'volume_size': 1} Feb 27 12:37:41 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1375093299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730bbca3-7fc7-491a-b949-5070a9a9b29c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbe54f3ac50488cbde094fe6af361ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:42Z,use_quota=True,user_id='3eb2a210d88047dab9a504a3aba16a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Creating volume 730bbca3-7fc7-491a-b949-5070a9a9b29c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:42 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.505s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Deleted volume successfully. Feb 27 12:37:42 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c 1073741824 Feb 27 12:37:42 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-31ccdfaf-6042-46c1-9cd7-39c74f33a02a tempest-VolumesActionsTest-2090897105 None] Lock "cinder-50dc3e0d-8798-4ad7-b1dc-b9de6fd3e05c-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:42 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c 1073741824" returned: 0 in 0.610s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:42 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c Feb 27 12:37:42 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:43 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c" returned: 0 in 0.457s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c319cfdd-40e5-493d-ac2c-1f6dbb55240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730bbca3-7fc7-491a-b949-5070a9a9b29c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655e4b37-149b-4730-a3c4-c45b1c669847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:43 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Volume volume-730bbca3-7fc7-491a-b949-5070a9a9b29c (730bbca3-7fc7-491a-b949-5070a9a9b29c): created successfully Feb 27 12:37:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655e4b37-149b-4730-a3c4-c45b1c669847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:43 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Flow 'volume_create_manager' (1173ae68-c522-40ed-a9bc-e51cc1b7f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1364dab4-3160-435e-8e2a-31a7563cfd00 tempest-VolumesActionsTest-646854440 None] Created volume successfully. Feb 27 12:37:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Acquiring lock "cinder-730bbca3-7fc7-491a-b949-5070a9a9b29c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Lock "cinder-730bbca3-7fc7-491a-b949-5070a9a9b29c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Acquiring lock "cinder-quobyte-730bbca3-7fc7-491a-b949-5070a9a9b29c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Lock "cinder-quobyte-730bbca3-7fc7-491a-b949-5070a9a9b29c" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[934fd91a-f467-47cd-972a-6450f934b9c7]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:44 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c Feb 27 12:37:44 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:45 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:45 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c Feb 27 12:37:45 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:45 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-730bbca3-7fc7-491a-b949-5070a9a9b29c" returned: 0 in 0.406s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Lock "cinder-quobyte-730bbca3-7fc7-491a-b949-5070a9a9b29c" released by "delete_volume" :: held 0.926s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Created reservations ['1a6cdcb0-7e4b-4ff8-9b12-7889c52d56df', '3321929e-6bf0-4a72-b03b-7c387a415d4e', '24ec0dc5-47c5-4ca7-b91a-520b1ab7181a', '1fc8bf36-e29e-4472-8370-21a85c3ccadc'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:45 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:37:45 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:46 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.464s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:46 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:37:46 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Deleted volume successfully. Feb 27 12:37:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd337ea5-9ded-4851-b47f-f22fc2116569 tempest-VolumesActionsTest-646854440 None] Lock "cinder-730bbca3-7fc7-491a-b949-5070a9a9b29c-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Flow 'volume_create_manager' (09db4f67-0991-4c57-8b59-691f4b148d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932f0fb1-ad60-4d9f-9e73-620ec8f49bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932f0fb1-ad60-4d9f-9e73-620ec8f49bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1409350559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f52d140dd6b48b9895e4be880c17405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:53Z,use_quota=True,user_id='464a619657c94a6a9f664938c70bfbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f85265e-5be5-4d84-8500-e714728fc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f85265e-5be5-4d84-8500-e714728fc275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da068a8f-e174-49e0-8826-a10a44bd8fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da068a8f-e174-49e0-8826-a10a44bd8fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50', 'volume_name': 'volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314f81ee-4d0c-44e1-a17d-70f6328761a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314f81ee-4d0c-44e1-a17d-70f6328761a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46d0b96-f3a2-4338-9b60-db4dbb7c37f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:52 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Volume a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50', 'volume_size': 1} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1409350559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f52d140dd6b48b9895e4be880c17405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:37:53Z,use_quota=True,user_id='464a619657c94a6a9f664938c70bfbcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Creating volume a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:37:52 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:37:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:52 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 1073741824 Feb 27 12:37:52 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:53 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 1073741824" returned: 0 in 0.545s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:53 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 Feb 27 12:37:53 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:53 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" returned: 0 in 0.406s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46d0b96-f3a2-4338-9b60-db4dbb7c37f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459bab9b-0c77-4fb0-87da-7e9501849031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:37:53 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Volume volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 (a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50): created successfully Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459bab9b-0c77-4fb0-87da-7e9501849031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:37:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Flow 'volume_create_manager' (09db4f67-0991-4c57-8b59-691f4b148d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:37:53 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-58e37f15-3269-4222-ba87-5d7012749701 tempest-SnapshotMetadataTestJSON-2095635173 None] Created volume successfully. Feb 27 12:37:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:37:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:37:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Creating offline snapshot b4fec16c-3a15-4c50-a7f4-44a15824276a of volume a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:37:55 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[662767da-6a92-44c2-9f9d-a26272b7bd8f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:55 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 Feb 27 12:37:55 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:55 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" returned: 0 in 0.486s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:55 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a 1G Feb 27 12:37:55 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:56 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a 1G" returned: 0 in 0.580s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:56 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a Feb 27 12:37:56 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:56 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a" returned: 0 in 0.455s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:56 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a is being set with open permissions: ugo+rw Feb 27 12:37:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:56 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a Feb 27 12:37:56 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:57 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a" returned: 0 in 0.382s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:57 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.info Feb 27 12:37:57 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:57 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.info" returned: 0 in 0.403s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:57 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.info is being set with open permissions: ugo+rw Feb 27 12:37:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:57 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.info Feb 27 12:37:57 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:57 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.info" returned: 0 in 0.420s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:37:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4d3a4cdd-c70f-4d48-b944-ccad5d34743e tempest-SnapshotMetadataTestJSON-2095635173 None] Create snapshot completed successfully Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "cinder-b4fec16c-3a15-4c50-a7f4-44a15824276a-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-b4fec16c-3a15-4c50-a7f4-44a15824276a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "cinder-quobyte-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-quobyte-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "cinder-quobyte-b4fec16c-3a15-4c50-a7f4-44a15824276a" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-quobyte-b4fec16c-3a15-4c50-a7f4-44a15824276a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Deleting offline snapshot b4fec16c-3a15-4c50-a7f4-44a15824276a of volume a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] snapshot_file for this snap is: volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724faf6-251b-4596-b949-f9bb74cded9a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:58 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a Feb 27 12:37:58 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:59 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a" returned: 0 in 0.484s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:37:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[dead2efe-cfe5-4709-95f2-b8d91b181c6c]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:37:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:59 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 Feb 27 12:37:59 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:37:59 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Feb 27 12:37:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" returned: 0 in 0.460s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:37:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:37:59 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a Feb 27 12:37:59 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:00 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:00 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a Feb 27 12:38:00 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:00 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50.b4fec16c-3a15-4c50-a7f4-44a15824276a" returned: 0 in 0.480s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-quobyte-b4fec16c-3a15-4c50-a7f4-44a15824276a" released by "_delete_snapshot" :: held 1.990s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-quobyte-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" released by "delete_snapshot" :: held 2.006s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:00 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Created reservations ['eaa79a5c-463c-4ab1-ae54-9c5c52d2f284', '58a78934-12f2-4597-bb94-b32e451539fb', '91b3f7df-0701-437c-b293-55496bef9e93', 'c58e806d-4835-4648-be4a-2878d637eb2a'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:00 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Delete snapshot completed successfully. Feb 27 12:38:00 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1a5cae3e-2cac-445c-8e30-008c1d4fc64e tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-b4fec16c-3a15-4c50-a7f4-44a15824276a-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "cinder-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "cinder-quobyte-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-quobyte-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[32263bc5-f073-4929-a02a-d654f533a308]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:02 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 Feb 27 12:38:02 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:02 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" returned: 0 in 0.532s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:02 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50 Feb 27 12:38:02 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:03 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" returned: 0 in 0.422s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-quobyte-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50" released by "delete_volume" :: held 0.994s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Created reservations ['da55e368-8d51-46ca-816b-0ac6bd9949b4', '3c0ab53a-f781-4aa8-913e-c7414859019c', '6b1760ce-befe-4041-a529-0466a112d803', '6d3ff7f0-16cc-46c4-b660-4f72d64a3c91'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:03 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:03 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:03 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.406s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:03 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Deleted volume successfully. Feb 27 12:38:03 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e5aa8691-cf5e-48ea-9599-49ae26e5d163 tempest-SnapshotMetadataTestJSON-2095635173 None] Lock "cinder-a3a9545b-6a2f-41fb-bbda-f4a8b86f8e50-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Flow 'volume_create_manager' (c17eaa9c-e592-4a75-887e-8205ff07c51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a9f097-f032-40bb-9bdc-22124ef07d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a9f097-f032-40bb-9bdc-22124ef07d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1819009081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcd3e78-7d11-4ea8-843d-1a68e2277c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b323e87c5d244b485bf791c46e87ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:07Z,use_quota=True,user_id='7242abf3cfee47dc92d7947d68f1b8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46412661-025f-45a8-8be7-39a5ccb2852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46412661-025f-45a8-8be7-39a5ccb2852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841f495c-d7df-40d1-8ae7-f943b8f2dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841f495c-d7df-40d1-8ae7-f943b8f2dab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fcd3e78-7d11-4ea8-843d-1a68e2277c14', 'volume_name': 'volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143a4139-2a4b-45ec-b4a6-76c89ab4797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143a4139-2a4b-45ec-b4a6-76c89ab4797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a831c918-a410-4102-a865-07f2f493a24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:06 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Volume 7fcd3e78-7d11-4ea8-843d-1a68e2277c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14', 'volume_size': 1} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1819009081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcd3e78-7d11-4ea8-843d-1a68e2277c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b323e87c5d244b485bf791c46e87ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:07Z,use_quota=True,user_id='7242abf3cfee47dc92d7947d68f1b8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Creating volume 7fcd3e78-7d11-4ea8-843d-1a68e2277c14 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:06 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:06 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 1073741824 Feb 27 12:38:06 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:07 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 1073741824" returned: 0 in 0.503s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:07 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 Feb 27 12:38:07 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:07 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14" returned: 0 in 0.438s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a831c918-a410-4102-a865-07f2f493a24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb81289-a260-4211-9db8-e7267d6a4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:07 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Volume volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 (7fcd3e78-7d11-4ea8-843d-1a68e2277c14): created successfully Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb81289-a260-4211-9db8-e7267d6a4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:07 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Flow 'volume_create_manager' (c17eaa9c-e592-4a75-887e-8205ff07c51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:07 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1240c47c-d5a0-4d95-954e-7d6bda969b02 tempest-VolumesTransfersV355Test-2101784354 None] Created volume successfully. Feb 27 12:38:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-05cad25d-b34a-4760-b9d2-3d6e533a0b7e tempest-VolumesTransfersV355Test-817843824 None] Transfer volume completed successfully. Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Acquiring lock "cinder-7fcd3e78-7d11-4ea8-843d-1a68e2277c14-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-7fcd3e78-7d11-4ea8-843d-1a68e2277c14-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Acquiring lock "cinder-quobyte-7fcd3e78-7d11-4ea8-843d-1a68e2277c14" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-quobyte-7fcd3e78-7d11-4ea8-843d-1a68e2277c14" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[380dca2f-fabe-45d8-9aab-169ce693baca]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:10 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 Feb 27 12:38:10 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:10 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14" returned: 0 in 0.497s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:10 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14 Feb 27 12:38:10 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:11 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7fcd3e78-7d11-4ea8-843d-1a68e2277c14" returned: 0 in 0.429s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-quobyte-7fcd3e78-7d11-4ea8-843d-1a68e2277c14" released by "delete_volume" :: held 0.959s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=113,cinder:UPDATE=162,cinder:INSERT=37,cinder:DELETE=13 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=127,cinder:UPDATE=173,cinder:INSERT=42,cinder:DELETE=15 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Created reservations ['c6ac8bc1-986a-4fdf-9b0b-0ea34fb68601', '7603ca1c-85a3-45b3-8d48-2c9a16495b20', '0e36bbdf-899e-4e27-8a5f-22dea838b4a9', '6ca6bbd2-bb36-4247-9108-ccb5be633dd3'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:11 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:11 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Flow 'volume_create_manager' (154708f1-22f9-4e45-bf94-fb4bb4ee8c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d569808-8114-4553-954d-0e290a8e52f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d569808-8114-4553-954d-0e290a8e52f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-680519141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d875450-6267-4ace-bc67-75cac0542d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b323e87c5d244b485bf791c46e87ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:12Z,use_quota=True,user_id='7242abf3cfee47dc92d7947d68f1b8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ceeeda-4861-4acc-9e6c-84790552eac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ceeeda-4861-4acc-9e6c-84790552eac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ed1292-9b1b-4ee2-a0d6-239e77631c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ed1292-9b1b-4ee2-a0d6-239e77631c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d875450-6267-4ace-bc67-75cac0542d60', 'volume_name': 'volume-5d875450-6267-4ace-bc67-75cac0542d60', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52bdae8f-9546-448e-a9a4-415bcaa93695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52bdae8f-9546-448e-a9a4-415bcaa93695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc873f2-82de-4865-9c54-137ab80a1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:11 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Volume 5d875450-6267-4ace-bc67-75cac0542d60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d875450-6267-4ace-bc67-75cac0542d60', 'volume_size': 1} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-680519141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d875450-6267-4ace-bc67-75cac0542d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b323e87c5d244b485bf791c46e87ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:12Z,use_quota=True,user_id='7242abf3cfee47dc92d7947d68f1b8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Creating volume 5d875450-6267-4ace-bc67-75cac0542d60 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:11 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:11 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:11 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 1073741824 Feb 27 12:38:11 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Deleted volume successfully. Feb 27 12:38:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9cd3e25d-9313-4353-ad42-eb46977401b8 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-7fcd3e78-7d11-4ea8-843d-1a68e2277c14-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:12 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 1073741824" returned: 0 in 0.518s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:12 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 Feb 27 12:38:12 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:12 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60" returned: 0 in 0.459s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc873f2-82de-4865-9c54-137ab80a1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d875450-6267-4ace-bc67-75cac0542d60', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca650a1-4484-4e00-8ea9-f87d9df4f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:12 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Volume volume-5d875450-6267-4ace-bc67-75cac0542d60 (5d875450-6267-4ace-bc67-75cac0542d60): created successfully Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca650a1-4484-4e00-8ea9-f87d9df4f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:12 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Flow 'volume_create_manager' (154708f1-22f9-4e45-bf94-fb4bb4ee8c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-70c4b6c1-907a-4083-bd2f-07be29c154e8 tempest-VolumesTransfersV355Test-2101784354 None] Created volume successfully. Feb 27 12:38:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Acquiring lock "cinder-5d875450-6267-4ace-bc67-75cac0542d60-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-5d875450-6267-4ace-bc67-75cac0542d60-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Acquiring lock "cinder-quobyte-5d875450-6267-4ace-bc67-75cac0542d60" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-quobyte-5d875450-6267-4ace-bc67-75cac0542d60" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9622f4fa-ab8a-44c2-9eac-c87faf37af9d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:14 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 Feb 27 12:38:14 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:14 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60" returned: 0 in 0.480s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:14 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60 Feb 27 12:38:14 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:14 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-5d875450-6267-4ace-bc67-75cac0542d60" returned: 0 in 0.408s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-quobyte-5d875450-6267-4ace-bc67-75cac0542d60" released by "delete_volume" :: held 0.918s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Created reservations ['6804fdfd-84a1-429e-8cd2-59e134c61979', '6bd4f942-3d9f-4a5b-881a-0c9e85d13be8', '3b1ced0d-36e0-420a-83e6-eec90ebf6feb', '92b33b2a-eba2-491e-a481-887ec5dd82f6'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:14 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:14 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:15 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.498s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:15 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:15 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Deleted volume successfully. Feb 27 12:38:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d9331619-38bc-4bd6-aec8-a975d3e7f234 tempest-VolumesTransfersV355Test-117071126 None] Lock "cinder-5d875450-6267-4ace-bc67-75cac0542d60-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Flow 'volume_create_manager' (827d3282-ef22-4cc4-8565-e1533c40b668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346cd968-b342-47ab-ad38-82ec3e37fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346cd968-b342-47ab-ad38-82ec3e37fc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-472659848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47f61b992ae14e33b2eadc4ac5a8cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:18Z,use_quota=True,user_id='c47b6672bd7a4c8eb806ac4a87ea0f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70d1ce4-7c59-4495-ab7c-4dbbe3613d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70d1ce4-7c59-4495-ab7c-4dbbe3613d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7108c077-0b77-4a77-b3d6-beb2f753ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7108c077-0b77-4a77-b3d6-beb2f753ab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454', 'volume_name': 'volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7e948-58b7-4367-90cb-4fb2a8eb2dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7e948-58b7-4367-90cb-4fb2a8eb2dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75981429-9c0d-472b-a05c-c00abb1f1b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Volume ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454', 'volume_size': 1} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-472659848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47f61b992ae14e33b2eadc4ac5a8cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:18Z,use_quota=True,user_id='c47b6672bd7a4c8eb806ac4a87ea0f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Creating volume ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:18 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:18 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 1073741824 Feb 27 12:38:18 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:18 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 1073741824" returned: 0 in 0.497s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:18 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 Feb 27 12:38:18 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:19 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454" returned: 0 in 0.426s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75981429-9c0d-472b-a05c-c00abb1f1b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261484fb-050e-437e-9050-be3f42729cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Volume volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 (ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454): created successfully Feb 27 12:38:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261484fb-050e-437e-9050-be3f42729cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Flow 'volume_create_manager' (827d3282-ef22-4cc4-8565-e1533c40b668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-931d1334-b9d3-4540-b31a-4d59d4f7b019 tempest-VolumesListTestJSON-1635717622 None] Created volume successfully. Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Flow 'volume_create_manager' (cd6d21bb-4ec7-4482-8053-3f8a32ea459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c0269-edd0-40a9-8b83-b63095f083da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c0269-edd0-40a9-8b83-b63095f083da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-125032208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f808b432-99a8-4ddc-af57-65bbcb83f7d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47f61b992ae14e33b2eadc4ac5a8cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:21Z,use_quota=True,user_id='c47b6672bd7a4c8eb806ac4a87ea0f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d413ccaf-09de-4844-9b62-8287081a96c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d413ccaf-09de-4844-9b62-8287081a96c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbffc02-ca39-4c92-a40c-d0eb20734546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbffc02-ca39-4c92-a40c-d0eb20734546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f808b432-99a8-4ddc-af57-65bbcb83f7d1', 'volume_name': 'volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2e0206-76f2-4ddf-98be-0301df03cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2e0206-76f2-4ddf-98be-0301df03cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905459c5-f438-482c-a5d8-6bf84316a7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Volume f808b432-99a8-4ddc-af57-65bbcb83f7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1', 'volume_size': 1} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-125032208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f808b432-99a8-4ddc-af57-65bbcb83f7d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47f61b992ae14e33b2eadc4ac5a8cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:21Z,use_quota=True,user_id='c47b6672bd7a4c8eb806ac4a87ea0f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Creating volume f808b432-99a8-4ddc-af57-65bbcb83f7d1 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:20 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:20 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 1073741824 Feb 27 12:38:20 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:21 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 1073741824" returned: 0 in 0.472s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:21 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 Feb 27 12:38:21 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:21 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1" returned: 0 in 0.413s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905459c5-f438-482c-a5d8-6bf84316a7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d952fce5-1d8f-4c24-b8df-2c25a48dafca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Volume volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 (f808b432-99a8-4ddc-af57-65bbcb83f7d1): created successfully Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d952fce5-1d8f-4c24-b8df-2c25a48dafca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Flow 'volume_create_manager' (cd6d21bb-4ec7-4482-8053-3f8a32ea459e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5e733a19-275c-4b6a-985e-a84fd0e3b1b1 tempest-VolumesListTestJSON-1635717622 None] Created volume successfully. Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Flow 'volume_create_manager' (04ae2e1d-2bbc-4a32-8394-ac7166c0bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc1a00f-1cad-49d2-9847-45e3be196a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc1a00f-1cad-49d2-9847-45e3be196a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-658566679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0671af2-bb69-4fc3-b93e-12319ebc0f24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47f61b992ae14e33b2eadc4ac5a8cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:23Z,use_quota=True,user_id='c47b6672bd7a4c8eb806ac4a87ea0f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7724d58-c64e-481c-a316-9e657c9f54e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7724d58-c64e-481c-a316-9e657c9f54e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18573d22-b425-4881-bfe0-8ba2b8683e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18573d22-b425-4881-bfe0-8ba2b8683e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0671af2-bb69-4fc3-b93e-12319ebc0f24', 'volume_name': 'volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc11918-ee8f-497e-9379-f4cf36b55190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc11918-ee8f-497e-9379-f4cf36b55190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4d8834-6096-4308-b7a5-ac47b4eda608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:23 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Volume e0671af2-bb69-4fc3-b93e-12319ebc0f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24', 'volume_size': 1} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-658566679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0671af2-bb69-4fc3-b93e-12319ebc0f24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47f61b992ae14e33b2eadc4ac5a8cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:23Z,use_quota=True,user_id='c47b6672bd7a4c8eb806ac4a87ea0f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Creating volume e0671af2-bb69-4fc3-b93e-12319ebc0f24 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:23 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:23 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 1073741824 Feb 27 12:38:23 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:23 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 1073741824" returned: 0 in 0.534s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:23 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 Feb 27 12:38:23 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:24 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24" returned: 0 in 0.429s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f4d8834-6096-4308-b7a5-ac47b4eda608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4792f98d-d9fa-4aed-9c14-a167d6a19b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:24 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Volume volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 (e0671af2-bb69-4fc3-b93e-12319ebc0f24): created successfully Feb 27 12:38:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4792f98d-d9fa-4aed-9c14-a167d6a19b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Flow 'volume_create_manager' (04ae2e1d-2bbc-4a32-8394-ac7166c0bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:24 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-15d5fa11-ec70-4d58-ba32-ace54e333d51 tempest-VolumesListTestJSON-1635717622 None] Created volume successfully. Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "cinder-e0671af2-bb69-4fc3-b93e-12319ebc0f24-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-e0671af2-bb69-4fc3-b93e-12319ebc0f24-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "cinder-quobyte-e0671af2-bb69-4fc3-b93e-12319ebc0f24" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-quobyte-e0671af2-bb69-4fc3-b93e-12319ebc0f24" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc52199-6d56-466e-af54-1276eebb7e64]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:27 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 Feb 27 12:38:27 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:27 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24" returned: 0 in 0.461s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:27 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24 Feb 27 12:38:27 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:28 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-e0671af2-bb69-4fc3-b93e-12319ebc0f24" returned: 0 in 0.382s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-quobyte-e0671af2-bb69-4fc3-b93e-12319ebc0f24" released by "delete_volume" :: held 0.866s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Created reservations ['7dcd33e3-fde7-4934-adff-1b3c81aa0edd', '5a34f8b0-6d40-46b7-9480-9c38537406fc', '4b281763-f798-4352-85cb-7b9393d608e2', 'd80899a9-aa2b-442f-99ac-a97bf6daa78e'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:28 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:28 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "cinder-f808b432-99a8-4ddc-af57-65bbcb83f7d1-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-f808b432-99a8-4ddc-af57-65bbcb83f7d1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "cinder-quobyte-f808b432-99a8-4ddc-af57-65bbcb83f7d1" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-quobyte-f808b432-99a8-4ddc-af57-65bbcb83f7d1" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14acfcd-c389-44fc-a642-7d04331c93d4]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:28 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 Feb 27 12:38:28 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:28 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.422s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:28 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Deleted volume successfully. Feb 27 12:38:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2825adc6-6ba3-4e60-997f-aa673f742beb tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-e0671af2-bb69-4fc3-b93e-12319ebc0f24-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:29 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1" returned: 0 in 0.487s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:29 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1 Feb 27 12:38:29 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:29 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f808b432-99a8-4ddc-af57-65bbcb83f7d1" returned: 0 in 0.400s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-quobyte-f808b432-99a8-4ddc-af57-65bbcb83f7d1" released by "delete_volume" :: held 0.920s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Created reservations ['7d08afa1-a809-4bd1-ab6a-6abf29f49fe0', '37b6aeb6-6fa0-447a-9592-dfea909dbd81', '84baaa5a-3376-4683-8e33-37b028bbd1d0', '4365e3f8-03a4-4092-bea3-a59a1307ff60'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:29 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:29 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "cinder-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "cinder-quobyte-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-quobyte-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[193e5180-3e23-4a09-8dd7-c7645caf1b11]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:29 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 Feb 27 12:38:29 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:29 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.395s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Deleted volume successfully. Feb 27 12:38:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6a9ed88c-09c5-4a24-adbf-8fc675edad51 tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-f808b432-99a8-4ddc-af57-65bbcb83f7d1-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:30 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454" returned: 0 in 0.466s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:30 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454 Feb 27 12:38:30 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:30 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454" returned: 0 in 0.388s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-quobyte-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454" released by "delete_volume" :: held 0.885s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Created reservations ['1f829598-c621-4cef-baa3-b7a2c51acdba', '0863af51-20b0-44b3-aa02-9b3e0f7df396', 'e465e447-66cf-4181-a801-94404e20862c', '9d070492-7101-4c05-9ae8-95c118a46ea9'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:30 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:30 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:31 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.459s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:31 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:31 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Deleted volume successfully. Feb 27 12:38:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8a41e82c-e04c-4e8c-bac0-12e73f6e922b tempest-VolumesListTestJSON-1635717622 None] Lock "cinder-ba6aa8f6-9bf7-4f94-b6f7-3d2be8551454-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (8e672708-0f50-48ed-9e85-f17375c59f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bd5851-89ab-4da4-a42c-9488db7bdb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bd5851-89ab-4da4-a42c-9488db7bdb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143967395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93492399-a5b4-43d7-b162-9db07a074749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:32Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b3200c-99f5-4ba0-a91f-69c41e016191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b3200c-99f5-4ba0-a91f-69c41e016191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8624c58e-5952-411b-9fa1-998cbb7d8e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8624c58e-5952-411b-9fa1-998cbb7d8e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93492399-a5b4-43d7-b162-9db07a074749', 'volume_name': 'volume-93492399-a5b4-43d7-b162-9db07a074749', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a032b-ebd1-4da6-98ee-7f83d5bab171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a032b-ebd1-4da6-98ee-7f83d5bab171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c62d91-04e3-42cd-91a8-c6e6fd2b6bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Volume 93492399-a5b4-43d7-b162-9db07a074749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93492399-a5b4-43d7-b162-9db07a074749', 'volume_size': 1} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143967395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93492399-a5b4-43d7-b162-9db07a074749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:32Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Creating volume 93492399-a5b4-43d7-b162-9db07a074749 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:32 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:32 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 1073741824 Feb 27 12:38:32 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (7d6469b8-3a86-466a-a646-38bcfa98e1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3584bf1e-0149-4fb2-bba2-e6dc9eb6244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3584bf1e-0149-4fb2-bba2-e6dc9eb6244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066186429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88597bb2-a5db-4bc2-8b63-ee5b1652c829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a3f017-326d-411f-a602-757c3a1ab0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a3f017-326d-411f-a602-757c3a1ab0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3688d0fb-2fc1-4228-a412-fa2c46c99686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3688d0fb-2fc1-4228-a412-fa2c46c99686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88597bb2-a5db-4bc2-8b63-ee5b1652c829', 'volume_name': 'volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eca4bb-e4bd-48af-a131-969dbe9f9d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eca4bb-e4bd-48af-a131-969dbe9f9d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e44d11a-95aa-4df6-ade1-22b46246f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Volume 88597bb2-a5db-4bc2-8b63-ee5b1652c829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829', 'volume_size': 1} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (acfbabe3-d44c-4036-8760-902a6226ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62ca030-a905-4118-980f-3c52147aa2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62ca030-a905-4118-980f-3c52147aa2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967787752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5823ecd-24d1-49db-85c7-b2ac764e93c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9e5202-d627-472f-b1b1-480942fb4cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9e5202-d627-472f-b1b1-480942fb4cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96eb3789-e5cc-4704-ad95-8312f11232bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96eb3789-e5cc-4704-ad95-8312f11232bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5823ecd-24d1-49db-85c7-b2ac764e93c8', 'volume_name': 'volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88a09b5-2fe8-4240-b5f6-a8ccfe937149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88a09b5-2fe8-4240-b5f6-a8ccfe937149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672f7d69-6386-47bc-a72e-99628cb07397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:32 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Volume b5823ecd-24d1-49db-85c7-b2ac764e93c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8', 'volume_size': 1} Feb 27 12:38:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:33 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 1073741824" returned: 0 in 0.567s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (a2edcf61-58df-48f9-b2f0-147c6909ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc64d6b-9cc6-4a5f-9956-06115dee783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc64d6b-9cc6-4a5f-9956-06115dee783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-671591999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7de304-feae-42ab-903c-576f3989bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7de304-feae-42ab-903c-576f3989bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006b7b7a-a541-4f54-ae28-16b249edc794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006b7b7a-a541-4f54-ae28-16b249edc794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3', 'volume_name': 'volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2d204a-13bc-4fe0-b34c-5f5d8b84642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2d204a-13bc-4fe0-b34c-5f5d8b84642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffedb13-ee54-447e-a4c7-d483d0e28b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Volume 93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3', 'volume_size': 1} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:33 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 Feb 27 12:38:33 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (657d06f9-26fd-4932-a319-5ba9a42ad657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f93736-eb1e-4a33-853d-cd2fa16c7a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f93736-eb1e-4a33-853d-cd2fa16c7a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078652215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0df8be-6641-4ec0-884a-268d71cc5af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7af16-4058-4a96-874c-9999710751b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7af16-4058-4a96-874c-9999710751b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46aa5d24-9eac-473b-831f-51114922e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46aa5d24-9eac-473b-831f-51114922e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0df8be-6641-4ec0-884a-268d71cc5af0', 'volume_name': 'volume-1d0df8be-6641-4ec0-884a-268d71cc5af0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c4f2ce-b522-407b-bc5f-30db9c959e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c4f2ce-b522-407b-bc5f-30db9c959e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff073a-65bf-4c24-9420-40d8ff4aeddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Volume 1d0df8be-6641-4ec0-884a-268d71cc5af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0df8be-6641-4ec0-884a-268d71cc5af0', 'volume_size': 1} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:33 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749" returned: 0 in 0.398s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.897s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066186429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88597bb2-a5db-4bc2-8b63-ee5b1652c829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Creating volume 88597bb2-a5db-4bc2-8b63-ee5b1652c829 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:33 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:33 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 1073741824 Feb 27 12:38:33 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c62d91-04e3-42cd-91a8-c6e6fd2b6bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93492399-a5b4-43d7-b162-9db07a074749', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb081544-7245-4780-9ac3-02dbdc2dc264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:33 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Volume volume-93492399-a5b4-43d7-b162-9db07a074749 (93492399-a5b4-43d7-b162-9db07a074749): created successfully Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb081544-7245-4780-9ac3-02dbdc2dc264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:33 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (8e672708-0f50-48ed-9e85-f17375c59f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:33 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-68a4b507-f2a9-4294-91cb-6e795b5993c3 tempest-CreateVolumesFromImageTest-590080253 None] Created volume successfully. Feb 27 12:38:34 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 1073741824" returned: 0 in 0.458s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:34 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 Feb 27 12:38:34 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:34 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829" returned: 0 in 0.396s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967787752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5823ecd-24d1-49db-85c7-b2ac764e93c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Creating volume b5823ecd-24d1-49db-85c7-b2ac764e93c8 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:34 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e44d11a-95aa-4df6-ade1-22b46246f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:34 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 1073741824 Feb 27 12:38:34 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd9b59c-9067-45a8-a600-24d86b65d0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:34 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Volume volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 (88597bb2-a5db-4bc2-8b63-ee5b1652c829): created successfully Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd9b59c-9067-45a8-a600-24d86b65d0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (7d6469b8-3a86-466a-a646-38bcfa98e1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:34 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-58dd5727-c04c-4379-8b3e-8f6affe243c7 tempest-CreateVolumesFromImageTest-590080253 None] Created volume successfully. Feb 27 12:38:34 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 1073741824" returned: 0 in 0.445s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:34 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 Feb 27 12:38:34 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:35 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8" returned: 0 in 0.400s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-671591999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Creating volume 93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:35 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672f7d69-6386-47bc-a72e-99628cb07397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d5dec3-a401-43ec-a15c-34b83261c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:35 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 1073741824 Feb 27 12:38:35 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:35 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Volume volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 (b5823ecd-24d1-49db-85c7-b2ac764e93c8): created successfully Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d5dec3-a401-43ec-a15c-34b83261c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (acfbabe3-d44c-4036-8760-902a6226ed55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e654dd8c-59da-4cc9-8f33-fe1f8a6e3a19 tempest-CreateVolumesFromImageTest-590080253 None] Created volume successfully. Feb 27 12:38:35 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 1073741824" returned: 0 in 0.468s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:35 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 Feb 27 12:38:35 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:36 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3" returned: 0 in 0.388s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.911s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078652215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0df8be-6641-4ec0-884a-268d71cc5af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd2d2ec8502457ca982a8a0e3bd9172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:33Z,use_quota=True,user_id='3faa573b811149a38713e3676b627cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Creating volume 1d0df8be-6641-4ec0-884a-268d71cc5af0 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:36 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffedb13-ee54-447e-a4c7-d483d0e28b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531ab742-d9e1-43eb-8a71-5a23fdd56a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:36 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 1073741824 Feb 27 12:38:36 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:36 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Volume volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 (93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3): created successfully Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531ab742-d9e1-43eb-8a71-5a23fdd56a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (a2edcf61-58df-48f9-b2f0-147c6909ac43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:36 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d2581233-0224-4034-9e9a-93694cfbf3d8 tempest-CreateVolumesFromImageTest-590080253 None] Created volume successfully. Feb 27 12:38:36 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 1073741824" returned: 0 in 0.476s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:36 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 Feb 27 12:38:36 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:37 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0" returned: 0 in 0.386s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeff073a-65bf-4c24-9420-40d8ff4aeddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0df8be-6641-4ec0-884a-268d71cc5af0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975e7984-918b-44ad-895d-dfb3d88d8db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:37 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Volume volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 (1d0df8be-6641-4ec0-884a-268d71cc5af0): created successfully Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975e7984-918b-44ad-895d-dfb3d88d8db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Flow 'volume_create_manager' (657d06f9-26fd-4932-a319-5ba9a42ad657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b8fd872c-b969-4589-8b07-8183d94de8ab tempest-CreateVolumesFromImageTest-590080253 None] Created volume successfully. Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-1d0df8be-6641-4ec0-884a-268d71cc5af0-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-1d0df8be-6641-4ec0-884a-268d71cc5af0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-quobyte-1d0df8be-6641-4ec0-884a-268d71cc5af0" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-1d0df8be-6641-4ec0-884a-268d71cc5af0" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17d91ad-6b99-43bf-be31-fdf08be9c309]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:37 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 Feb 27 12:38:37 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:38 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0" returned: 0 in 0.445s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:38 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0 Feb 27 12:38:38 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:38 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-1d0df8be-6641-4ec0-884a-268d71cc5af0" returned: 0 in 0.380s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-1d0df8be-6641-4ec0-884a-268d71cc5af0" released by "delete_volume" :: held 0.846s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Created reservations ['5973118c-01eb-49a8-ad30-f1001bd77a3a', 'd83f3f7b-fb0b-4029-8b5f-cb9cc1cbe823', 'ed80e1fa-1388-4bf7-8068-c1aef7b59dd0', 'dc5cf1ca-aa65-4f95-a92c-b751e070da9e'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:38 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:38 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-quobyte-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e79ac-726e-416b-a80d-d77f2aae65f6]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:38 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 Feb 27 12:38:38 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:39 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.414s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:39 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Deleted volume successfully. Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-9a49063b-ae68-4af5-84db-0957cbb71ae7 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-1d0df8be-6641-4ec0-884a-268d71cc5af0-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:39 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3" returned: 0 in 0.473s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:39 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3 Feb 27 12:38:39 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:39 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3" returned: 0 in 0.409s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3" released by "delete_volume" :: held 0.903s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Created reservations ['2bafb7ae-97cb-43e6-a0d7-53526da2cfc6', '56ec9837-18eb-496d-a6cd-8a9be31acda5', '4fcf8b8b-7bc1-4a49-b4db-244886300f30', '3c2ea4d1-67f6-444f-a929-8589d3d161b2'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:39 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:39 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-b5823ecd-24d1-49db-85c7-b2ac764e93c8-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-b5823ecd-24d1-49db-85c7-b2ac764e93c8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-quobyte-b5823ecd-24d1-49db-85c7-b2ac764e93c8" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-b5823ecd-24d1-49db-85c7-b2ac764e93c8" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c519a7ee-0843-41e8-8129-b2847ee187a7]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:40 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 Feb 27 12:38:40 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:40 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.440s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:40 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Deleted volume successfully. Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-f8ef8796-ec7a-48d7-83c5-6a7190577e72 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-93aef3ff-29bb-4ba6-b3b2-32bb95b3e9a3-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:40 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8" returned: 0 in 0.472s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:40 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8 Feb 27 12:38:40 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:40 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b5823ecd-24d1-49db-85c7-b2ac764e93c8" returned: 0 in 0.376s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-b5823ecd-24d1-49db-85c7-b2ac764e93c8" released by "delete_volume" :: held 0.872s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Created reservations ['1c545333-936d-40bc-a176-cf30282a6099', '8a0ff815-2129-4d5b-8350-c316f94499c0', 'a073130b-d6ef-43e9-a02e-4e6eb1f247f6', 'be4a7af9-184c-43c4-ae65-d37e8a6a13b8'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:40 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:40 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-88597bb2-a5db-4bc2-8b63-ee5b1652c829-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-88597bb2-a5db-4bc2-8b63-ee5b1652c829-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-quobyte-88597bb2-a5db-4bc2-8b63-ee5b1652c829" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-88597bb2-a5db-4bc2-8b63-ee5b1652c829" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b7ef27-de51-43e6-96e3-3b208e3bd3c7]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:41 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 Feb 27 12:38:41 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:41 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.410s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Deleted volume successfully. Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2069402a-9f09-47ba-ad40-1e7f4985bfb1 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-b5823ecd-24d1-49db-85c7-b2ac764e93c8-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:41 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829" returned: 0 in 0.451s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:41 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829 Feb 27 12:38:41 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:41 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-88597bb2-a5db-4bc2-8b63-ee5b1652c829" returned: 0 in 0.390s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-88597bb2-a5db-4bc2-8b63-ee5b1652c829" released by "delete_volume" :: held 0.863s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Created reservations ['97241c94-a8ba-4f4f-8b22-3f24c6204e20', '49ec9d74-525e-4ea3-97d6-b60c9f3c2360', '3e33317b-676e-4e2c-ab99-b586c78b942e', 'cbdd01b2-4706-44cc-95e7-61641f7362fd'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:41 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:41 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-93492399-a5b4-43d7-b162-9db07a074749-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-93492399-a5b4-43d7-b162-9db07a074749-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "cinder-quobyte-93492399-a5b4-43d7-b162-9db07a074749" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-93492399-a5b4-43d7-b162-9db07a074749" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa1694a-9a51-4b47-ab5a-933821fa157b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:42 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 Feb 27 12:38:42 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:42 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.416s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:42 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Deleted volume successfully. Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-3693b574-4754-41e7-b5be-ca8694e36230 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-88597bb2-a5db-4bc2-8b63-ee5b1652c829-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:42 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749" returned: 0 in 0.459s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:42 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749 Feb 27 12:38:42 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:42 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-93492399-a5b4-43d7-b162-9db07a074749" returned: 0 in 0.384s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-quobyte-93492399-a5b4-43d7-b162-9db07a074749" released by "delete_volume" :: held 0.874s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Created reservations ['920e2b87-262b-4c2c-8339-adf3820c9236', '9c856057-acb4-4630-8130-f4daf5ddec5b', 'cbf9aa99-77b3-4e8c-8a54-3717e5fd2367', '5304101f-c0e7-4407-bfec-cb73857552e6'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:43 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:43 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:43 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.434s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Deleted volume successfully. Feb 27 12:38:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-29b596cf-1914-4f6a-a568-ad0882f331d2 tempest-CreateVolumesFromImageTest-590080253 None] Lock "cinder-93492399-a5b4-43d7-b162-9db07a074749-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (8e13ac32-426c-41f1-964c-be72ff60652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9369ef3-aa23-4a61-b903-8bbe941e9c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9369ef3-aa23-4a61-b903-8bbe941e9c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1783847482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ececf5-7abb-4ca6-bb38-fc970fb26c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086bc12805ec47d3a35a72c9916e9e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:45Z,use_quota=True,user_id='2c7d9a0c166b42dda419e4183e98b01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f963bd0-24bd-4f91-a127-5a6d0cbf60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f963bd0-24bd-4f91-a127-5a6d0cbf60d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8e79ea-d4f9-4ef8-a7c5-8530096df7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8e79ea-d4f9-4ef8-a7c5-8530096df7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ececf5-7abb-4ca6-bb38-fc970fb26c5d', 'volume_name': 'volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9ce766-f812-455f-9532-74d95ebe11be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9ce766-f812-455f-9532-74d95ebe11be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c5cc2d-106f-415b-857b-9e9e5850623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:44 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Volume b1ececf5-7abb-4ca6-bb38-fc970fb26c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d', 'volume_size': 1} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1783847482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ececf5-7abb-4ca6-bb38-fc970fb26c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086bc12805ec47d3a35a72c9916e9e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:45Z,use_quota=True,user_id='2c7d9a0c166b42dda419e4183e98b01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Creating volume b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:44 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:44 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d 1073741824 Feb 27 12:38:44 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:45 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d 1073741824" returned: 0 in 0.459s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:45 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d Feb 27 12:38:45 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:45 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" returned: 0 in 0.385s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c5cc2d-106f-415b-857b-9e9e5850623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003e98b7-b1a5-47f8-a928-91c961b752e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:45 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Volume volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d (b1ececf5-7abb-4ca6-bb38-fc970fb26c5d): created successfully Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003e98b7-b1a5-47f8-a928-91c961b752e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (8e13ac32-426c-41f1-964c-be72ff60652c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:45 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b55a4ef8-ab0f-4908-86a5-117369ea8abd tempest-VolumeDependencyTests-68758255 None] Created volume successfully. Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Creating offline snapshot ce2cdd75-f418-4354-a3c9-d8e65833c288 of volume b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a335869f-086a-4aa8-8b72-4d00cb015563]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:46 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d Feb 27 12:38:46 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:46 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" returned: 0 in 0.467s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:46 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 1G Feb 27 12:38:46 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:46 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 1G" returned: 0 in 0.439s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:46 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 Feb 27 12:38:46 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:47 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288" returned: 0 in 0.398s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:47 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 is being set with open permissions: ugo+rw Feb 27 12:38:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:47 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 Feb 27 12:38:47 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:47 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288" returned: 0 in 0.377s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:47 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.info Feb 27 12:38:47 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:48 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.info" returned: 0 in 0.390s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:48 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.info is being set with open permissions: ugo+rw Feb 27 12:38:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:48 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.info Feb 27 12:38:48 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:48 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.info" returned: 0 in 0.380s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:48 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:48 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-67f5a2d7-2bb5-4c02-b022-fcd1855d0a07 tempest-VolumeDependencyTests-68758255 None] Create snapshot completed successfully Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (a8a73b18-fba2-41c8-a55d-69c7510a11de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41782047-90c8-4ec5-94e7-a480e913808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41782047-90c8-4ec5-94e7-a480e913808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1048169342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ed0fad-733d-47f3-8474-15d95752019a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086bc12805ec47d3a35a72c9916e9e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce2cdd75-f418-4354-a3c9-d8e65833c288,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:49Z,use_quota=True,user_id='2c7d9a0c166b42dda419e4183e98b01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27397e18-e7d4-43fd-9bd4-9088d3ca5a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27397e18-e7d4-43fd-9bd4-9088d3ca5a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eab4d1-2b06-4b0c-80c7-f1563757bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53eab4d1-2b06-4b0c-80c7-f1563757bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48ed0fad-733d-47f3-8474-15d95752019a', 'volume_name': 'volume-48ed0fad-733d-47f3-8474-15d95752019a', 'volume_size': 1, 'snapshot_id': 'ce2cdd75-f418-4354-a3c9-d8e65833c288'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d5fe36-eae0-425e-8638-d920726f1cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d5fe36-eae0-425e-8638-d920726f1cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca9913e-e61e-4195-b592-e720060c6d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:49 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Volume 48ed0fad-733d-47f3-8474-15d95752019a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48ed0fad-733d-47f3-8474-15d95752019a', 'volume_size': 1, 'snapshot_id': 'ce2cdd75-f418-4354-a3c9-d8e65833c288'} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-ce2cdd75-f418-4354-a3c9-d8e65833c288-48ed0fad-733d-47f3-8474-15d95752019a" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-ce2cdd75-f418-4354-a3c9-d8e65833c288-48ed0fad-733d-47f3-8474-15d95752019a" acquired by "_create_volume_from_snapshot" :: waited 0.005s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Creating volume 48ed0fad-733d-47f3-8474-15d95752019a from snapshot ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-48ed0fad-733d-47f3-8474-15d95752019a" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-48ed0fad-733d-47f3-8474-15d95752019a" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] snapshot: ce2cdd75-f418-4354-a3c9-d8e65833c288, volume: 48ed0fad-733d-47f3-8474-15d95752019a, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e51b3-dc1e-4603-8315-88a38e29315f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:49 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 Feb 27 12:38:49 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:49 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288" returned: 0 in 0.440s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c0052-4781-4a62-8a27-54659b033fe9]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:49 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d Feb 27 12:38:49 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:50 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" returned: 0 in 0.473s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:50 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:38:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:50 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a Feb 27 12:38:50 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:52 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a" returned: 0 in 2.054s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:52 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1355c1a4-3220-4007-abb7-eeebbe95c072]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:52 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d Feb 27 12:38:52 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:53 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" returned: 0 in 0.610s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:38:53 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Converted 1024.00 MB image at 498.16 MB/s Feb 27 12:38:53 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a is being set with open permissions: ugo+rw Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:53 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a Feb 27 12:38:53 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:53 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a" returned: 0 in 0.398s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-48ed0fad-733d-47f3-8474-15d95752019a" released by "_copy_volume_from_snapshot" :: held 4.035s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-ce2cdd75-f418-4354-a3c9-d8e65833c288-48ed0fad-733d-47f3-8474-15d95752019a" released by "_create_volume_from_snapshot" :: held 4.049s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.055s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca9913e-e61e-4195-b592-e720060c6d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ed0fad-733d-47f3-8474-15d95752019a', 'volume_size': 1, 'snapshot_id': 'ce2cdd75-f418-4354-a3c9-d8e65833c288'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3598e194-beb7-4159-98f2-d800aca2e98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:53 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Volume volume-48ed0fad-733d-47f3-8474-15d95752019a (48ed0fad-733d-47f3-8474-15d95752019a): created successfully Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3598e194-beb7-4159-98f2-d800aca2e98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (a8a73b18-fba2-41c8-a55d-69c7510a11de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:53 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6216f2c7-d572-42c8-a14c-937a95471e3d tempest-VolumeDependencyTests-68758255 None] Created volume successfully. Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-ce2cdd75-f418-4354-a3c9-d8e65833c288-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-ce2cdd75-f418-4354-a3c9-d8e65833c288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-ce2cdd75-f418-4354-a3c9-d8e65833c288" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-ce2cdd75-f418-4354-a3c9-d8e65833c288" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Deleting offline snapshot ce2cdd75-f418-4354-a3c9-d8e65833c288 of volume b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] snapshot_file for this snap is: volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec32f0-c2c0-4d03-9647-caf166865bf3]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:53 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 Feb 27 12:38:53 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:54 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288" returned: 0 in 0.471s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:38:54 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb20e0-5dff-48e4-80d2-abb54f91e53a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:54 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d Feb 27 12:38:54 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:54 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" returned: 0 in 0.454s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:54 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 Feb 27 12:38:54 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:55 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288" returned: 0 in 0.443s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:55 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288 Feb 27 12:38:55 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:55 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d.ce2cdd75-f418-4354-a3c9-d8e65833c288" returned: 0 in 0.397s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-ce2cdd75-f418-4354-a3c9-d8e65833c288" released by "_delete_snapshot" :: held 1.820s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" released by "delete_snapshot" :: held 1.830s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Created reservations ['8d7d8321-763d-4b45-b003-47bacd303234', '6d4f725a-3317-4ba2-aa25-759ac27d589a', 'e63e369e-8031-44fd-8621-634051596fbf', 'd251edfa-f597-44a1-ac9d-6f8e3de01315'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:55 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Delete snapshot completed successfully. Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e9bb43b8-0830-4e4d-b69c-7769487ec103 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-ce2cdd75-f418-4354-a3c9-d8e65833c288-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b862c9d-4ea3-4c42-99bf-44d62a4efd9f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:55 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d Feb 27 12:38:55 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:56 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" returned: 0 in 0.444s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:56 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d Feb 27 12:38:56 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:56 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" returned: 0 in 0.400s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d" released by "delete_volume" :: held 0.880s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Created reservations ['6772ed35-3636-40d8-99a3-bbb3262b5972', '5849bbdd-39c7-4ae6-8c7d-8701a295bb90', '97193bcf-f4c9-45b7-8594-07a296b49067', '1587afec-958b-4545-8a6c-c7163d52e502'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:56 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:38:56 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (5a89631b-f99b-4f60-b4c6-79cec03b6b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08e89c-1a94-4452-97ac-41c9e71ac28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f08e89c-1a94-4452-97ac-41c9e71ac28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224856137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec91c4b0-f4bd-4f69-8458-0387f97a8e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086bc12805ec47d3a35a72c9916e9e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:57Z,use_quota=True,user_id='2c7d9a0c166b42dda419e4183e98b01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db2fb68-159a-48f4-a320-f813865feff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db2fb68-159a-48f4-a320-f813865feff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da93cd-e6e1-4aeb-8a69-2484176b1f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da93cd-e6e1-4aeb-8a69-2484176b1f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec91c4b0-f4bd-4f69-8458-0387f97a8e3b', 'volume_name': 'volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94b0162-43cf-45df-bc55-636cf0ddb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94b0162-43cf-45df-bc55-636cf0ddb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87182043-1fe1-48e9-ba87-b359ed6b909b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:57 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Volume ec91c4b0-f4bd-4f69-8458-0387f97a8e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b', 'volume_size': 1} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224856137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec91c4b0-f4bd-4f69-8458-0387f97a8e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086bc12805ec47d3a35a72c9916e9e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:57Z,use_quota=True,user_id='2c7d9a0c166b42dda419e4183e98b01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Creating volume ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:57 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:38:57 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.428s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:38:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Deleted volume successfully. Feb 27 12:38:57 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b 1073741824 Feb 27 12:38:57 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ef8e35d8-c518-4c75-9d64-6f9a1b26d1d0 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-b1ececf5-7abb-4ca6-bb38-fc970fb26c5d-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:38:57 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b 1073741824" returned: 0 in 0.451s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:57 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b Feb 27 12:38:57 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:57 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" returned: 0 in 0.380s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87182043-1fe1-48e9-ba87-b359ed6b909b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deea7e0-bf4d-4799-aaa8-bf182b0ac097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:57 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Volume volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b (ec91c4b0-f4bd-4f69-8458-0387f97a8e3b): created successfully Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deea7e0-bf4d-4799-aaa8-bf182b0ac097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (5a89631b-f99b-4f60-b4c6-79cec03b6b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-9f6e4588-bba7-4db0-bea1-faaa88008d93 tempest-VolumeDependencyTests-68758255 None] Created volume successfully. Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (889bb887-eee9-4903-9238-e61710e1d7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155cf705-4b96-4dc9-a5c6-f7efb066e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155cf705-4b96-4dc9-a5c6-f7efb066e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-821100689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99881e1b-8cfb-4fbb-8f8d-c35ff70774f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086bc12805ec47d3a35a72c9916e9e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ec91c4b0-f4bd-4f69-8458-0387f97a8e3b,status='creating',terminated_at=None,updated_at=2026-02-27T11:38:58Z,use_quota=True,user_id='2c7d9a0c166b42dda419e4183e98b01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8960c877-c35a-40ee-92ec-717db6f42632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8960c877-c35a-40ee-92ec-717db6f42632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc0032d-860a-417b-bffd-b439f655d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc0032d-860a-417b-bffd-b439f655d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '99881e1b-8cfb-4fbb-8f8d-c35ff70774f8', 'volume_name': 'volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8', 'volume_size': 1, 'source_volid': 'ec91c4b0-f4bd-4f69-8458-0387f97a8e3b', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c37608d-af88-498d-84b1-cba4ff8c0d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c37608d-af88-498d-84b1-cba4ff8c0d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d515beb1-4cae-45c1-a68d-d87179c506ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:38:58 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Volume 99881e1b-8cfb-4fbb-8f8d-c35ff70774f8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8', 'volume_size': 1, 'source_volid': 'ec91c4b0-f4bd-4f69-8458-0387f97a8e3b', 'source_volstatus': 'available'} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:38:58 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Cloning volume ec91c4b0-f4bd-4f69-8458-0387f97a8e3b to volume 99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Creating offline snapshot e30c0d12-6d2a-4af9-85d1-fb772e875a8b of volume ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[30481fe7-dec5-4bc3-a0d2-67d70e5c7267]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:58 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b Feb 27 12:38:58 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:58 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" returned: 0 in 0.447s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:58 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b 1G Feb 27 12:38:58 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:59 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b 1G" returned: 0 in 0.473s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:59 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b Feb 27 12:38:59 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:38:59 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Feb 27 12:38:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b" returned: 0 in 0.399s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:38:59 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b is being set with open permissions: ugo+rw Feb 27 12:38:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:38:59 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b Feb 27 12:38:59 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:00 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b" returned: 0 in 0.405s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:00 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.info Feb 27 12:39:00 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:00 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.info" returned: 0 in 0.411s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:00 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.info is being set with open permissions: ugo+rw Feb 27 12:39:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:00 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.info Feb 27 12:39:00 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:00 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.info" returned: 0 in 0.391s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] snapshot: e30c0d12-6d2a-4af9-85d1-fb772e875a8b, volume: 99881e1b-8cfb-4fbb-8f8d-c35ff70774f8, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e8e7a-01ec-4903-9188-28108bb128f3]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:01 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b Feb 27 12:39:01 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:01 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b" returned: 0 in 0.472s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8653c4-da5b-47ea-ba9f-28c434702461]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:01 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b Feb 27 12:39:01 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:01 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" returned: 0 in 0.469s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:39:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:02 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 Feb 27 12:39:02 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:04 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" returned: 0 in 2.144s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:04 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a108d-2213-42fc-9505-78ef4c739f26]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:04 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b Feb 27 12:39:04 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:04 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" returned: 0 in 0.597s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:04 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b, size 1024.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:39:04 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Converted 1024.00 MB image at 477.44 MB/s Feb 27 12:39:04 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 is being set with open permissions: ugo+rw Feb 27 12:39:04 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:04 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 Feb 27 12:39:04 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:05 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" returned: 0 in 0.394s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" released by "_copy_volume_from_snapshot" :: held 4.122s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-e30c0d12-6d2a-4af9-85d1-fb772e875a8b" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-e30c0d12-6d2a-4af9-85d1-fb772e875a8b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Deleting offline snapshot e30c0d12-6d2a-4af9-85d1-fb772e875a8b of volume ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] snapshot_file for this snap is: volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51391e-cfca-4d16-ba64-6dc92f498cf0]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:05 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b Feb 27 12:39:05 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:05 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b" returned: 0 in 0.469s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab2674-e08a-4c2d-8492-835a6a652b27]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:05 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b Feb 27 12:39:05 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:06 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" returned: 0 in 0.471s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:06 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b Feb 27 12:39:06 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:06 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b" returned: 0 in 0.418s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:06 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b Feb 27 12:39:06 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:06 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b.e30c0d12-6d2a-4af9-85d1-fb772e875a8b" returned: 0 in 0.391s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-e30c0d12-6d2a-4af9-85d1-fb772e875a8b" released by "_delete_snapshot" :: held 1.794s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.545s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d515beb1-4cae-45c1-a68d-d87179c506ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8', 'volume_size': 1, 'source_volid': 'ec91c4b0-f4bd-4f69-8458-0387f97a8e3b', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbb28eb-e92a-4145-a280-3852b752d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:06 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Volume volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 (99881e1b-8cfb-4fbb-8f8d-c35ff70774f8): created successfully Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbb28eb-e92a-4145-a280-3852b752d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:06 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Flow 'volume_create_manager' (889bb887-eee9-4903-9238-e61710e1d7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:06 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-a906a4de-c2db-447d-9f6f-82c0dbed3b3c tempest-VolumeDependencyTests-68758255 None] Created volume successfully. Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:07 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:07 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:07 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.402s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:07 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e51ea-0a78-4f89-8cc0-e3aaecff9b64]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:08 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b Feb 27 12:39:08 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:08 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" returned: 0 in 0.465s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:08 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b Feb 27 12:39:08 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:08 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" returned: 0 in 0.406s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b" released by "delete_volume" :: held 0.907s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Created reservations ['933bd150-28e9-4488-9208-da91545f8255', '02876e66-8157-4f2e-bc71-f75cbc23d1ad', 'd2f4c022-9304-4ea6-a429-527c6bd99b08', '4cb2e7df-979c-4fc9-bfe3-a675c3897960'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:08 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:08 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Lock "cinder-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[389a763c-9de3-452c-8e1e-5a79bbf76a97]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:09 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 Feb 27 12:39:09 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:09 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.417s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Deleted volume successfully. Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-710a44fc-1339-4e64-a635-8957bfb78df9 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-ec91c4b0-f4bd-4f69-8458-0387f97a8e3b-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:09 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" returned: 0 in 0.473s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:09 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8 Feb 27 12:39:09 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:10 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" returned: 0 in 0.393s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8" released by "delete_volume" :: held 0.891s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Created reservations ['5ee807c2-36ff-4c02-a49a-ffb3ddbc43db', 'd1e463da-f50c-46e2-b87a-8b639ac6ff11', 'bcea4c9a-a7de-4f03-a64f-98fe908c9a52', 'de66194b-2bde-4fb2-88ad-678d12e9daa1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:10 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:10 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-48ed0fad-733d-47f3-8474-15d95752019a-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-48ed0fad-733d-47f3-8474-15d95752019a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "cinder-quobyte-48ed0fad-733d-47f3-8474-15d95752019a" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-48ed0fad-733d-47f3-8474-15d95752019a" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefe5417-b60f-4324-9aec-6bb216b32fc8]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:10 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a Feb 27 12:39:10 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:10 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.438s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:10 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Deleted volume successfully. Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-6601c9ea-17d4-4ace-a3d9-fb839024713e tempest-VolumeDependencyTests-68758255 None] Lock "cinder-99881e1b-8cfb-4fbb-8f8d-c35ff70774f8-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:10 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a" returned: 0 in 0.467s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:10 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a Feb 27 12:39:10 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:11 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-48ed0fad-733d-47f3-8474-15d95752019a" returned: 0 in 0.404s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-quobyte-48ed0fad-733d-47f3-8474-15d95752019a" released by "delete_volume" :: held 0.904s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:UPDATE=150,cinder:SELECT=103,cinder:INSERT=35,cinder:DELETE=14 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=105,cinder:INSERT=36,cinder:UPDATE=152,cinder:DELETE=13 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Created reservations ['4502a76c-3a6e-4758-9aa1-ce356ab715b3', 'ebe2fe56-e1b3-43c8-9834-002a4e8daead', '14c45577-58f7-4dfc-a8fb-8818d6e2ad18', '0c657e71-9ff6-4fa6-8798-d509110b8099'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:11 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:11 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:11 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.479s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Deleted volume successfully. Feb 27 12:39:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0199c9d6-d6f3-438d-8c0b-ee770f6b15a8 tempest-VolumeDependencyTests-68758255 None] Lock "cinder-48ed0fad-733d-47f3-8474-15d95752019a-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (05c6d3a7-834c-4b7c-84c1-d4ec70027a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e4f7f5-aac7-48d9-8374-00c381119044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e4f7f5-aac7-48d9-8374-00c381119044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1659022745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd69af7-d3de-4779-bf26-8fb54cee7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:18Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb95da3b-d29f-44ed-ac12-d47f2a00dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb95da3b-d29f-44ed-ac12-d47f2a00dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023cec43-1f75-48e3-94ee-cf1789a743eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023cec43-1f75-48e3-94ee-cf1789a743eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd69af7-d3de-4779-bf26-8fb54cee7887', 'volume_name': 'volume-2cd69af7-d3de-4779-bf26-8fb54cee7887', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8215451c-63ce-46a3-8bd8-4e11b2a00466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8215451c-63ce-46a3-8bd8-4e11b2a00466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b850acd-1dc3-4ee7-9552-456c5fdd2c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Volume 2cd69af7-d3de-4779-bf26-8fb54cee7887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd69af7-d3de-4779-bf26-8fb54cee7887', 'volume_size': 1} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1659022745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd69af7-d3de-4779-bf26-8fb54cee7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:18Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Creating volume 2cd69af7-d3de-4779-bf26-8fb54cee7887 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:18 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:18 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 1073741824 Feb 27 12:39:18 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (ca5fad7f-5db3-4bdc-a7a3-bef7664d7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0fd60b-8860-46ab-ad57-5e44ac19d0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0fd60b-8860-46ab-ad57-5e44ac19d0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-828146420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c4df3a-40c4-454f-a373-a64fbe62b526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:18Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8071db5f-265c-4bac-ac20-c84317d420bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8071db5f-265c-4bac-ac20-c84317d420bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d82751-c9dc-46fe-ad5b-01e561b0de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d82751-c9dc-46fe-ad5b-01e561b0de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c4df3a-40c4-454f-a373-a64fbe62b526', 'volume_name': 'volume-39c4df3a-40c4-454f-a373-a64fbe62b526', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4595eb07-1398-45b1-8931-f065b83f09f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4595eb07-1398-45b1-8931-f065b83f09f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae48719-684a-45a8-be54-5ca78c17ea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume 39c4df3a-40c4-454f-a373-a64fbe62b526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c4df3a-40c4-454f-a373-a64fbe62b526', 'volume_size': 1} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (823edeab-d905-4881-ae69-818feae29407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4927ddd9-027b-4d9d-a0c7-89509b8a26ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4927ddd9-027b-4d9d-a0c7-89509b8a26ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2080304029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13329ae2-930c-4761-bd20-65067e226af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01296194-64f0-4e4d-80d7-99aff5bdf7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01296194-64f0-4e4d-80d7-99aff5bdf7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b080e8f-3972-4d1a-b077-b84cbb8bd315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b080e8f-3972-4d1a-b077-b84cbb8bd315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13329ae2-930c-4761-bd20-65067e226af2', 'volume_name': 'volume-13329ae2-930c-4761-bd20-65067e226af2', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c9d42b-2139-4d24-afe9-667d17559bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c9d42b-2139-4d24-afe9-667d17559bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac61c09-4ac6-4d77-a707-312d0cc16168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Volume 13329ae2-930c-4761-bd20-65067e226af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13329ae2-930c-4761-bd20-65067e226af2', 'volume_size': 1} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (d6b4b92e-cf6e-48ce-b1ff-2dcc99ce962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5a4556-61dc-41d3-953a-484a738baab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5a4556-61dc-41d3-953a-484a738baab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1052514429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082007c0-16c4-40d9-9054-b16042ca1b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feed2df41b1497fb49c5e5ec5b2e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='fb949bb9311e4df8933bcddbe9872774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d424364b-ad2a-4a1b-9768-807cdbec4541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d424364b-ad2a-4a1b-9768-807cdbec4541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f3ae67-8eab-4e41-95c8-2271678439ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f3ae67-8eab-4e41-95c8-2271678439ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082007c0-16c4-40d9-9054-b16042ca1b9a', 'volume_name': 'volume-082007c0-16c4-40d9-9054-b16042ca1b9a', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81220226-ea10-4e5b-a494-2b9899f4e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81220226-ea10-4e5b-a494-2b9899f4e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5082ec4-7150-4294-a8a0-90e5bd9a81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:18 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Volume 082007c0-16c4-40d9-9054-b16042ca1b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082007c0-16c4-40d9-9054-b16042ca1b9a', 'volume_size': 1} Feb 27 12:39:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (2862800c-5fbd-4ecc-b966-2fc380c8113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338c7649-36fb-408b-9c07-c16d966a0fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338c7649-36fb-408b-9c07-c16d966a0fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2077077602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59eb3b85-c818-4985-895e-139587fb005c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fd58d7-9ecd-42cb-8e1a-dc7247a0ebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2fd58d7-9ecd-42cb-8e1a-dc7247a0ebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd94149d-45d3-44c9-8a2e-8aebd78d5a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd94149d-45d3-44c9-8a2e-8aebd78d5a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59eb3b85-c818-4985-895e-139587fb005c', 'volume_name': 'volume-59eb3b85-c818-4985-895e-139587fb005c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f132eb3-f639-46e8-94dc-9fc0d4cab97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f132eb3-f639-46e8-94dc-9fc0d4cab97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfe632e-75e3-4042-bb0a-46307797020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Volume 59eb3b85-c818-4985-895e-139587fb005c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59eb3b85-c818-4985-895e-139587fb005c', 'volume_size': 1} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (0c780185-e30b-4882-a99b-106c86eda69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5331d12-bb6e-4cbc-9534-37ce5b003ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5331d12-bb6e-4cbc-9534-37ce5b003ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-599445188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a8b715-b195-4c88-ae3a-bfc01f1baebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0ec65f-6725-47e8-8abb-1ce7d947269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0ec65f-6725-47e8-8abb-1ce7d947269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22718256-f825-401e-b8c9-c88a662d3365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22718256-f825-401e-b8c9-c88a662d3365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a8b715-b195-4c88-ae3a-bfc01f1baebb', 'volume_name': 'volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8518891-6efe-4f72-be92-2a576d6ea0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8518891-6efe-4f72-be92-2a576d6ea0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf763d96-101a-4c3d-b2f6-4df9698a7a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Volume 77a8b715-b195-4c88-ae3a-bfc01f1baebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb', 'volume_size': 1} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:19 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 1073741824" returned: 0 in 0.772s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:19 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 Feb 27 12:39:19 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (654ba014-7801-4d50-b824-f29cd5be6485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16533ad9-0dec-463a-9303-498df6c611e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16533ad9-0dec-463a-9303-498df6c611e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-755591403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0631ed-c898-4ee8-bad8-2c47dc054c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55880f9e-cd94-445f-9cd2-b472a694ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55880f9e-cd94-445f-9cd2-b472a694ec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e302ff8e-9390-4844-a4f3-172b5c8e0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e302ff8e-9390-4844-a4f3-172b5c8e0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0631ed-c898-4ee8-bad8-2c47dc054c4c', 'volume_name': 'volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185ea4e8-2772-4865-92dc-135a854d38fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (185ea4e8-2772-4865-92dc-135a854d38fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6bfbcb-f025-4420-88ad-a51ae58993ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Volume ea0631ed-c898-4ee8-bad8-2c47dc054c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c', 'volume_size': 1} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:19 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887" returned: 0 in 0.444s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-828146420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c4df3a-40c4-454f-a373-a64fbe62b526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:18Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Creating volume 39c4df3a-40c4-454f-a373-a64fbe62b526 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:19 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b850acd-1dc3-4ee7-9552-456c5fdd2c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd69af7-d3de-4779-bf26-8fb54cee7887', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d54253-e32e-4b13-942c-733d6aae9124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:19 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 1073741824 Feb 27 12:39:19 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:19 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Volume volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 (2cd69af7-d3de-4779-bf26-8fb54cee7887): created successfully Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d54253-e32e-4b13-942c-733d6aae9124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:19 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (05c6d3a7-834c-4b7c-84c1-d4ec70027a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d4ff2f53-1124-4d65-a1bb-74c9292896f9 tempest-CreateVolumesFromImageTest-540742447 None] Created volume successfully. Feb 27 12:39:20 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 1073741824" returned: 0 in 0.546s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:20 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 Feb 27 12:39:20 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:20 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526" returned: 0 in 0.475s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2080304029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13329ae2-930c-4761-bd20-65067e226af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Creating volume 13329ae2-930c-4761-bd20-65067e226af2 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:20 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae48719-684a-45a8-be54-5ca78c17ea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c4df3a-40c4-454f-a373-a64fbe62b526', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:20 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 1073741824 Feb 27 12:39:20 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ae27b9-fa41-4a64-be52-acf25633c5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:20 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume volume-39c4df3a-40c4-454f-a373-a64fbe62b526 (39c4df3a-40c4-454f-a373-a64fbe62b526): created successfully Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ae27b9-fa41-4a64-be52-acf25633c5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:20 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (ca5fad7f-5db3-4bdc-a7a3-bef7664d7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:20 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cab5fa11-e6a6-4a04-997c-e91951a984d9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created volume successfully. Feb 27 12:39:21 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 1073741824" returned: 0 in 0.474s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:21 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 Feb 27 12:39:21 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:21 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2" returned: 0 in 0.399s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.794s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1052514429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082007c0-16c4-40d9-9054-b16042ca1b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feed2df41b1497fb49c5e5ec5b2e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='fb949bb9311e4df8933bcddbe9872774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Creating volume 082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:21 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:21 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a 1073741824 Feb 27 12:39:21 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac61c09-4ac6-4d77-a707-312d0cc16168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13329ae2-930c-4761-bd20-65067e226af2', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef5f9e9-716e-4d56-b516-a1a3aaa09555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:21 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Volume volume-13329ae2-930c-4761-bd20-65067e226af2 (13329ae2-930c-4761-bd20-65067e226af2): created successfully Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef5f9e9-716e-4d56-b516-a1a3aaa09555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:21 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (823edeab-d905-4881-ae69-818feae29407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:21 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-23a3ea98-9812-425b-925c-857fc86171b2 tempest-CreateVolumesFromImageTest-540742447 None] Created volume successfully. Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (1514aaf9-8c2d-419b-b1fb-fe769e9b7456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148f0c50-9e44-41ba-b2db-97ccacacbdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148f0c50-9e44-41ba-b2db-97ccacacbdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-291506367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ea34bd-257e-4136-9b6b-a05fde764836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:22Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49071c0d-97d1-4ffc-a39d-c81071512820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49071c0d-97d1-4ffc-a39d-c81071512820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0de24a-7349-4e5b-8b0a-ecf91206bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0de24a-7349-4e5b-8b0a-ecf91206bea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ea34bd-257e-4136-9b6b-a05fde764836', 'volume_name': 'volume-15ea34bd-257e-4136-9b6b-a05fde764836', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11716481-050c-4327-bc89-1aed9877796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11716481-050c-4327-bc89-1aed9877796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3adcaff-7a73-43d5-971a-de79a4231b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume 15ea34bd-257e-4136-9b6b-a05fde764836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ea34bd-257e-4136-9b6b-a05fde764836', 'volume_size': 1} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:22 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a 1073741824" returned: 0 in 0.621s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:22 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a Feb 27 12:39:22 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (fa169afa-1472-4234-bc96-aa76187eb614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3d2d76-ad1a-4c18-b3a9-e6d4fa162aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3d2d76-ad1a-4c18-b3a9-e6d4fa162aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630934849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abac874d-9ff5-4470-9feb-a2abad5f703e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:22Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360ce0a1-c03a-40cb-85ea-995812bfeda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360ce0a1-c03a-40cb-85ea-995812bfeda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178c1307-6a52-4cb8-8b73-0c2484ed36bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178c1307-6a52-4cb8-8b73-0c2484ed36bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abac874d-9ff5-4470-9feb-a2abad5f703e', 'volume_name': 'volume-abac874d-9ff5-4470-9feb-a2abad5f703e', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d66feb4-7406-4864-9cb4-c307d1212a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d66feb4-7406-4864-9cb4-c307d1212a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca77b351-9cd6-493f-ad30-0f5f30d9aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume abac874d-9ff5-4470-9feb-a2abad5f703e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abac874d-9ff5-4470-9feb-a2abad5f703e', 'volume_size': 1} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (dc2dc436-4182-47a9-bd63-c0296bfb4e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37701dd3-ac9e-4dd2-95ce-be221848f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37701dd3-ac9e-4dd2-95ce-be221848f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935425625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14dfac7-8645-4002-89a4-ffec9a30df3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:23Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ea3f2a-69c2-49b7-be5e-71ef70d19459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ea3f2a-69c2-49b7-be5e-71ef70d19459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b8778e-0aca-4a35-ba9b-be7013afdbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b8778e-0aca-4a35-ba9b-be7013afdbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14dfac7-8645-4002-89a4-ffec9a30df3a', 'volume_name': 'volume-a14dfac7-8645-4002-89a4-ffec9a30df3a', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c59b891-2b89-4c7f-bb56-9b1f4b9b0699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c59b891-2b89-4c7f-bb56-9b1f4b9b0699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2001ae8-ba9e-42e4-b1bb-72d2c7dc1138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:22 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume a14dfac7-8645-4002-89a4-ffec9a30df3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14dfac7-8645-4002-89a4-ffec9a30df3a', 'volume_size': 1} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:22 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (f4489acd-3e75-45ba-9331-5dc17ab5f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5383291b-3c95-423f-b8ee-06f7775798c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5383291b-3c95-423f-b8ee-06f7775798c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062730985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64838ee-84d2-45c1-aacd-6b2c4a308879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:23Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe5f8d8-4598-45ed-9cb4-6f1069ff4744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe5f8d8-4598-45ed-9cb4-6f1069ff4744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b789ff3-686e-45da-9a7a-cdf692126408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b789ff3-686e-45da-9a7a-cdf692126408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b64838ee-84d2-45c1-aacd-6b2c4a308879', 'volume_name': 'volume-b64838ee-84d2-45c1-aacd-6b2c4a308879', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43821a9-f4bc-452a-a15b-75bd12d2f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43821a9-f4bc-452a-a15b-75bd12d2f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e115dc3c-d5ff-413f-a419-9e7ae50e32fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume b64838ee-84d2-45c1-aacd-6b2c4a308879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b64838ee-84d2-45c1-aacd-6b2c4a308879', 'volume_size': 1} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:23 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a" returned: 0 in 0.782s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.153s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2077077602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59eb3b85-c818-4985-895e-139587fb005c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Creating volume 59eb3b85-c818-4985-895e-139587fb005c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:23 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:23 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c 1073741824 Feb 27 12:39:23 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5082ec4-7150-4294-a8a0-90e5bd9a81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082007c0-16c4-40d9-9054-b16042ca1b9a', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3481890-9b80-4769-b86c-1b80f28ffddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Volume volume-082007c0-16c4-40d9-9054-b16042ca1b9a (082007c0-16c4-40d9-9054-b16042ca1b9a): created successfully Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3481890-9b80-4769-b86c-1b80f28ffddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (d6b4b92e-cf6e-48ce-b1ff-2dcc99ce962c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:23 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-236526d0-21e5-43df-9d5a-ea86926835cf tempest-VolumeDependencyTests-1884231912 None] Created volume successfully. Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (1efb95d7-2771-403b-8533-c16f6c3d4558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9741a7e2-4229-4135-a7a1-c240bf10a06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9741a7e2-4229-4135-a7a1-c240bf10a06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458672386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d766bb-d7b2-4fc0-a242-225a2ee4af22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:23Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edb8494-59f0-46a3-9a75-deac7b72121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edb8494-59f0-46a3-9a75-deac7b72121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978951f5-e62e-440a-8175-6e3de5220d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978951f5-e62e-440a-8175-6e3de5220d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d766bb-d7b2-4fc0-a242-225a2ee4af22', 'volume_name': 'volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced0c021-5fed-426e-9a1d-7048277f4eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced0c021-5fed-426e-9a1d-7048277f4eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb0c881-1c91-4e66-bb04-d06c729216e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:23 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume 63d766bb-d7b2-4fc0-a242-225a2ee4af22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22', 'volume_size': 1} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:23 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c 1073741824" returned: 0 in 0.518s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:23 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c Feb 27 12:39:23 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:24 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c" returned: 0 in 0.468s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.943s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-599445188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a8b715-b195-4c88-ae3a-bfc01f1baebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Creating volume 77a8b715-b195-4c88-ae3a-bfc01f1baebb {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:24 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfe632e-75e3-4042-bb0a-46307797020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59eb3b85-c818-4985-895e-139587fb005c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04351488-25f4-4b47-8616-b48250a380c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:24 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Volume volume-59eb3b85-c818-4985-895e-139587fb005c (59eb3b85-c818-4985-895e-139587fb005c): created successfully Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04351488-25f4-4b47-8616-b48250a380c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:24 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb 1073741824 Feb 27 12:39:24 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (2862800c-5fbd-4ecc-b966-2fc380c8113e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:24 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3564f4a1-6f3a-46d2-a1ae-809b9c337de0 tempest-CreateVolumesFromImageTest-540742447 None] Created volume successfully. Feb 27 12:39:24 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb 1073741824" returned: 0 in 0.569s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:24 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:24 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb Feb 27 12:39:24 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:25 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb" returned: 0 in 0.468s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.737s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-755591403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0631ed-c898-4ee8-bad8-2c47dc054c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39714967e4b441b9a7920d2bb54d74d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:19Z,use_quota=True,user_id='152685edb16d42e6b363767dad5cc05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Creating volume ea0631ed-c898-4ee8-bad8-2c47dc054c4c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:25 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf763d96-101a-4c3d-b2f6-4df9698a7a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25a7838-7da5-48b3-b42c-ebe79afd6f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:25 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c 1073741824 Feb 27 12:39:25 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:25 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Volume volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb (77a8b715-b195-4c88-ae3a-bfc01f1baebb): created successfully Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25a7838-7da5-48b3-b42c-ebe79afd6f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (0c780185-e30b-4882-a99b-106c86eda69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:25 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-dc7d94b3-27d9-4dfd-a160-b65ba91d1a31 tempest-CreateVolumesFromImageTest-540742447 None] Created volume successfully. Feb 27 12:39:25 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c 1073741824" returned: 0 in 0.583s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:25 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:25 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c Feb 27 12:39:25 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:26 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c" returned: 0 in 0.428s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.099s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-291506367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ea34bd-257e-4136-9b6b-a05fde764836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:22Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Creating volume 15ea34bd-257e-4136-9b6b-a05fde764836 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:26 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6bfbcb-f025-4420-88ad-a51ae58993ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8b30c2-7fd1-4dcf-a109-06eb180172da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:26 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 1073741824 Feb 27 12:39:26 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:26 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Volume volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c (ea0631ed-c898-4ee8-bad8-2c47dc054c4c): created successfully Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8b30c2-7fd1-4dcf-a109-06eb180172da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Flow 'volume_create_manager' (654ba014-7801-4d50-b824-f29cd5be6485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:26 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-60d89a4b-b039-4d3f-bd64-fc9f5e0cf7d5 tempest-CreateVolumesFromImageTest-540742447 None] Created volume successfully. Feb 27 12:39:26 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 1073741824" returned: 0 in 0.498s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:26 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:26 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 Feb 27 12:39:26 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-ea0631ed-c898-4ee8-bad8-2c47dc054c4c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-ea0631ed-c898-4ee8-bad8-2c47dc054c4c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-quobyte-ea0631ed-c898-4ee8-bad8-2c47dc054c4c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-ea0631ed-c898-4ee8-bad8-2c47dc054c4c" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc10223a-d609-4cee-90e7-ca28db12f94f]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:27 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c Feb 27 12:39:27 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:27 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836" returned: 0 in 0.499s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.807s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-630934849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abac874d-9ff5-4470-9feb-a2abad5f703e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:22Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Creating volume abac874d-9ff5-4470-9feb-a2abad5f703e {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:27 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3adcaff-7a73-43d5-971a-de79a4231b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ea34bd-257e-4136-9b6b-a05fde764836', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4947a417-4696-43b1-9e6e-e70bba89f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:27 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e 1073741824 Feb 27 12:39:27 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:27 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume volume-15ea34bd-257e-4136-9b6b-a05fde764836 (15ea34bd-257e-4136-9b6b-a05fde764836): created successfully Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4947a417-4696-43b1-9e6e-e70bba89f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (1514aaf9-8c2d-419b-b1fb-fe769e9b7456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:27 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-18caefe4-3313-406c-97a1-53e95351b5c0 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created volume successfully. Feb 27 12:39:27 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:27 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c Feb 27 12:39:27 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:27 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e 1073741824" returned: 0 in 0.546s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:27 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:28 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e Feb 27 12:39:28 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:28 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-ea0631ed-c898-4ee8-bad8-2c47dc054c4c" returned: 0 in 0.509s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-ea0631ed-c898-4ee8-bad8-2c47dc054c4c" released by "delete_volume" :: held 1.066s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Created reservations ['1a10ad7b-abb9-4205-8758-a4906a44b336', '46f69616-77b4-413f-a251-a47b5fc049c4', '2b2c35b0-bae3-4d8a-808b-9bd1a8e51953', '21a9fb85-70ac-42c7-85cd-fc60ea1744ec'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:28 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:28 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:28 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e" returned: 0 in 0.545s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.707s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935425625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14dfac7-8645-4002-89a4-ffec9a30df3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:23Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Creating volume a14dfac7-8645-4002-89a4-ffec9a30df3a {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:28 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca77b351-9cd6-493f-ad30-0f5f30d9aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abac874d-9ff5-4470-9feb-a2abad5f703e', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47b8a64-b26e-4be4-b481-1644c0ee450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:28 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a 1073741824 Feb 27 12:39:28 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume volume-abac874d-9ff5-4470-9feb-a2abad5f703e (abac874d-9ff5-4470-9feb-a2abad5f703e): created successfully Feb 27 12:39:28 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47b8a64-b26e-4be4-b481-1644c0ee450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (fa169afa-1472-4234-bc96-aa76187eb614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:28 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ac258170-e407-4212-ab7f-70d034c23ea9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created volume successfully. Feb 27 12:39:28 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.477s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:28 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Deleted volume successfully. Feb 27 12:39:28 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-47410096-bca1-40bf-bfc3-4da1ee401efb tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-ea0631ed-c898-4ee8-bad8-2c47dc054c4c-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:29 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a 1073741824" returned: 0 in 0.551s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:29 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a Feb 27 12:39:29 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-77a8b715-b195-4c88-ae3a-bfc01f1baebb-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-77a8b715-b195-4c88-ae3a-bfc01f1baebb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-quobyte-77a8b715-b195-4c88-ae3a-bfc01f1baebb" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-77a8b715-b195-4c88-ae3a-bfc01f1baebb" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91df741-dabf-4ad1-b5b8-3c609fef90ae]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:29 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb Feb 27 12:39:29 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:29 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a" returned: 0 in 0.468s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.484s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062730985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b64838ee-84d2-45c1-aacd-6b2c4a308879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:23Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Creating volume b64838ee-84d2-45c1-aacd-6b2c4a308879 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:29 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2001ae8-ba9e-42e4-b1bb-72d2c7dc1138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14dfac7-8645-4002-89a4-ffec9a30df3a', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1b1365-bcba-466a-8948-5f0bf9f70674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:29 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 1073741824 Feb 27 12:39:29 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:29 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume volume-a14dfac7-8645-4002-89a4-ffec9a30df3a (a14dfac7-8645-4002-89a4-ffec9a30df3a): created successfully Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1b1365-bcba-466a-8948-5f0bf9f70674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:29 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (dc2dc436-4182-47a9-bd63-c0296bfb4e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:29 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-236ed72d-ad2c-4d1d-9db6-8dc08baf5be5 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created volume successfully. Feb 27 12:39:30 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb" returned: 0 in 0.550s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:30 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb Feb 27 12:39:30 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:30 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 1073741824" returned: 0 in 0.599s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:30 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 Feb 27 12:39:30 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:30 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-77a8b715-b195-4c88-ae3a-bfc01f1baebb" returned: 0 in 0.560s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-77a8b715-b195-4c88-ae3a-bfc01f1baebb" released by "delete_volume" :: held 1.144s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Created reservations ['127da25f-319f-473a-b1d4-cbb884e61bec', '5dcd0ee3-458c-4a1f-8c43-0e3507c98bf4', '4c3eeaa4-1a0e-48bd-b780-a85e8b1fa9f4', '19e642b3-ffa6-4b7f-bc9b-9a06ee87f797'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:30 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:30 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:30 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.303s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1458672386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d766bb-d7b2-4fc0-a242-225a2ee4af22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed7c22e2fe3e4e6aacb92292f43f9ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:23Z,use_quota=True,user_id='2edc26d6c2a5456a899345c1772259ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Creating volume 63d766bb-d7b2-4fc0-a242-225a2ee4af22 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:30 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e115dc3c-d5ff-413f-a419-9e7ae50e32fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64838ee-84d2-45c1-aacd-6b2c4a308879', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fef85da-23e0-4f79-a544-f51fa121cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:30 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 1073741824 Feb 27 12:39:30 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:30 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 (b64838ee-84d2-45c1-aacd-6b2c4a308879): created successfully Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fef85da-23e0-4f79-a544-f51fa121cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:30 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (f4489acd-3e75-45ba-9331-5dc17ab5f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:30 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-530099b5-ce0e-413a-bbba-8fd50bb29f46 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created volume successfully. Feb 27 12:39:31 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.517s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:31 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Deleted volume successfully. Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ce58d925-62c4-471b-a3d8-5e7d61376bf6 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-77a8b715-b195-4c88-ae3a-bfc01f1baebb-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:31 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 1073741824" returned: 0 in 0.543s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:31 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 Feb 27 12:39:31 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-59eb3b85-c818-4985-895e-139587fb005c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-59eb3b85-c818-4985-895e-139587fb005c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-quobyte-59eb3b85-c818-4985-895e-139587fb005c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-59eb3b85-c818-4985-895e-139587fb005c" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de32ab4-f63d-430a-85bc-dcc5b972de97]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:31 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c Feb 27 12:39:31 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:31 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22" returned: 0 in 0.521s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.619s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb0c881-1c91-4e66-bb04-d06c729216e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5bee8a-afe5-4c63-9915-20655b3fb522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Creating offline snapshot aa001d3d-13a6-4e25-bceb-71d55472c7be of volume 082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:39:31 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Volume volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 (63d766bb-d7b2-4fc0-a242-225a2ee4af22): created successfully Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5bee8a-afe5-4c63-9915-20655b3fb522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Flow 'volume_create_manager' (1efb95d7-2771-403b-8533-c16f6c3d4558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[5291f230-18db-4b24-956b-d5170fed8e2d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:31 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:31 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d9d39ad6-6007-48c7-91d2-6012465eb44e tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created volume successfully. Feb 27 12:39:31 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a Feb 27 12:39:31 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-63d766bb-d7b2-4fc0-a242-225a2ee4af22-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-63d766bb-d7b2-4fc0-a242-225a2ee4af22-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-quobyte-63d766bb-d7b2-4fc0-a242-225a2ee4af22" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-63d766bb-d7b2-4fc0-a242-225a2ee4af22" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0528d523-7a5a-4a3d-899f-bc4b32967226]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:32 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 Feb 27 12:39:32 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:32 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c" returned: 0 in 0.568s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:32 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c Feb 27 12:39:32 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:32 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a" returned: 0 in 0.672s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:32 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be 1G Feb 27 12:39:32 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:32 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-59eb3b85-c818-4985-895e-139587fb005c" returned: 0 in 0.444s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-59eb3b85-c818-4985-895e-139587fb005c" released by "delete_volume" :: held 1.035s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:32 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22" returned: 0 in 0.603s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:32 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22 Feb 27 12:39:32 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Created reservations ['dab85b64-4990-4b97-9e73-4e36a9328bec', '631052f8-3e46-49df-b14f-c5aa1e81c1aa', '51203f04-7358-47be-9435-b9d1cb30691c', 'b2be0c99-803a-4636-8553-5660f34b0efc'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:32 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:32 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:32 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:33 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-63d766bb-d7b2-4fc0-a242-225a2ee4af22" returned: 0 in 0.407s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-63d766bb-d7b2-4fc0-a242-225a2ee4af22" released by "delete_volume" :: held 1.037s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created reservations ['c48795eb-ec61-4fc6-bb1c-85b36e4f7c88', 'a4a2a8f9-ff26-4b0f-8d42-a9429570e9eb', 'c275845b-028b-4e2d-aa91-e6085931a527', '4d336b54-93d2-44cf-8cdb-fe3671d9e4fb'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:33 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be 1G" returned: 0 in 0.658s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082007c0-16c4-40d9-9054-b16042ca1b9a -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:33 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082007c0-16c4-40d9-9054-b16042ca1b9a -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be Feb 27 12:39:33 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:33 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:33 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:33 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.541s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:33 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Deleted volume successfully. Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e37f4fb3-fd7c-4035-968c-1b77b2d910e4 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-59eb3b85-c818-4985-895e-139587fb005c-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:33 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082007c0-16c4-40d9-9054-b16042ca1b9a -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:33 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be is being set with open permissions: ugo+rw Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:33 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be Feb 27 12:39:33 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:33 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-13329ae2-930c-4761-bd20-65067e226af2-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.501s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:33 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Deleted volume successfully. Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-13329ae2-930c-4761-bd20-65067e226af2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-be11fd63-894d-44e6-a69f-6662200087eb tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-63d766bb-d7b2-4fc0-a242-225a2ee4af22-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-quobyte-13329ae2-930c-4761-bd20-65067e226af2" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-13329ae2-930c-4761-bd20-65067e226af2" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[df351e86-9636-4101-a310-4cad0de988c6]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:33 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:33 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 Feb 27 12:39:33 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Flow 'volume_create_manager' (7bfee1ef-4ea9-43be-a37c-76775dac01eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4951a6-4679-4937-ba5c-63b90587e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4951a6-4679-4937-ba5c-63b90587e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162903373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a69a0d-bdab-4841-9c4b-8242c88095b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbf93d2953247a0bae1cd72336b1934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:34Z,use_quota=True,user_id='48acdfaec28a4cc893c726fa1c85b3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27262f73-5b5e-4d79-bd6d-6e3e36d31a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27262f73-5b5e-4d79-bd6d-6e3e36d31a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c6c56f-e897-43f3-8446-b9a3f59a7669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c6c56f-e897-43f3-8446-b9a3f59a7669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a69a0d-bdab-4841-9c4b-8242c88095b5', 'volume_name': 'volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169b531f-8bd2-48d2-874f-1554e88dbf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:34 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169b531f-8bd2-48d2-874f-1554e88dbf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6002e0eb-7078-4945-a993-786aaa64685a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:34 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Volume f2a69a0d-bdab-4841-9c4b-8242c88095b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5', 'volume_size': 1} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be" returned: 0 in 0.420s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:34 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.info Feb 27 12:39:34 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-b64838ee-84d2-45c1-aacd-6b2c4a308879-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-b64838ee-84d2-45c1-aacd-6b2c4a308879-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-quobyte-b64838ee-84d2-45c1-aacd-6b2c4a308879" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-b64838ee-84d2-45c1-aacd-6b2c4a308879" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b66bc-9c0d-48e2-8d75-77fdec077fff]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:34 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 Feb 27 12:39:34 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:34 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2" returned: 0 in 0.570s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:34 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2 Feb 27 12:39:34 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:34 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.info" returned: 0 in 0.446s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:34 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.info is being set with open permissions: ugo+rw Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:34 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.info Feb 27 12:39:34 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:34 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879" returned: 0 in 0.474s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:34 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879 Feb 27 12:39:34 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:34 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-13329ae2-930c-4761-bd20-65067e226af2" returned: 0 in 0.389s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-13329ae2-930c-4761-bd20-65067e226af2" released by "delete_volume" :: held 0.986s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Created reservations ['d78126f3-0b31-443f-b0c1-4121b1d00e44', '5fddbd26-de97-4163-924a-3a004d52f6fb', '1a20abe7-29ca-47de-9c37-d58a32fbedec', 'f58d2b9a-4b7a-4019-a43e-2a5ace481b74'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:34 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:34 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:34 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:35 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.info" returned: 0 in 0.432s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.161s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162903373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a69a0d-bdab-4841-9c4b-8242c88095b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbf93d2953247a0bae1cd72336b1934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:34Z,use_quota=True,user_id='48acdfaec28a4cc893c726fa1c85b3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Creating volume f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:35 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:35 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 1073741824 Feb 27 12:39:35 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-6119d13f-243c-4a52-a4c4-9e4a99ddd040 tempest-VolumeDependencyTests-1884231912 None] Create snapshot completed successfully Feb 27 12:39:35 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-b64838ee-84d2-45c1-aacd-6b2c4a308879" returned: 0 in 0.465s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-b64838ee-84d2-45c1-aacd-6b2c4a308879" released by "delete_volume" :: held 0.960s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created reservations ['d2bad194-b7b8-4f09-8d0b-41de8fd7c4a4', '7bc97991-2255-44b3-9ffb-b24721960634', 'b592aa3d-0615-4ac0-b00b-1a3ca0379b0c', '8091300c-2e8b-4c41-a145-cdb5098a4610'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:35 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.417s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Deleted volume successfully. Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-1f75bf8d-90c1-47c9-a641-14df5e4ee296 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-13329ae2-930c-4761-bd20-65067e226af2-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:35 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:35 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-a14dfac7-8645-4002-89a4-ffec9a30df3a-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-a14dfac7-8645-4002-89a4-ffec9a30df3a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-quobyte-a14dfac7-8645-4002-89a4-ffec9a30df3a" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-a14dfac7-8645-4002-89a4-ffec9a30df3a" acquired by "delete_volume" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc48154d-1976-4f17-9847-257490b4c139]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:35 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 1073741824" returned: 0 in 0.522s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:35 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a Feb 27 12:39:35 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:35 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 Feb 27 12:39:35 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:35 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.504s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:35 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Deleted volume successfully. Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (fcf1237f-fac6-4537-8289-74b5135526f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f7590d-fc80-4a43-bc96-05aef1a8d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f7590d-fc80-4a43-bc96-05aef1a8d89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-235553221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e40446e-ce6d-43ec-a4df-d0cd38fa8834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feed2df41b1497fb49c5e5ec5b2e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa001d3d-13a6-4e25-bceb-71d55472c7be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:36Z,use_quota=True,user_id='fb949bb9311e4df8933bcddbe9872774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a1df33-50a6-4526-b848-c34839afd825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a1df33-50a6-4526-b848-c34839afd825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35cf0b1-7b9c-4791-a144-d85928cef652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35cf0b1-7b9c-4791-a144-d85928cef652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e40446e-ce6d-43ec-a4df-d0cd38fa8834', 'volume_name': 'volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834', 'volume_size': 1, 'snapshot_id': 'aa001d3d-13a6-4e25-bceb-71d55472c7be'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d62eee-6715-4053-95c1-b8d9076f60ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d62eee-6715-4053-95c1-b8d9076f60ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3556d7fb-ff50-4a24-85ce-911ccec654c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:35 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Volume 8e40446e-ce6d-43ec-a4df-d0cd38fa8834: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834', 'volume_size': 1, 'snapshot_id': 'aa001d3d-13a6-4e25-bceb-71d55472c7be'} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-2cd69af7-d3de-4779-bf26-8fb54cee7887-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:35 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-306ea15b-d56f-45ee-a3b6-af8dfe2f2bd3 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-b64838ee-84d2-45c1-aacd-6b2c4a308879-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-2cd69af7-d3de-4779-bf26-8fb54cee7887-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "cinder-quobyte-2cd69af7-d3de-4779-bf26-8fb54cee7887" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-2cd69af7-d3de-4779-bf26-8fb54cee7887" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[682cd62e-567e-458b-8f1a-95b87a8f901d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:36 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5" returned: 0 in 0.471s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:36 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.075s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-aa001d3d-13a6-4e25-bceb-71d55472c7be-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a" returned: 0 in 0.579s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6002e0eb-7078-4945-a993-786aaa64685a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e39ea29-9238-42b9-a066-b27babb5e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:36 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a Feb 27 12:39:36 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-aa001d3d-13a6-4e25-bceb-71d55472c7be-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Creating volume 8e40446e-ce6d-43ec-a4df-d0cd38fa8834 from snapshot aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:36 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Volume volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 (f2a69a0d-bdab-4841-9c4b-8242c88095b5): created successfully Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e39ea29-9238-42b9-a066-b27babb5e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Flow 'volume_create_manager' (7bfee1ef-4ea9-43be-a37c-76775dac01eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] snapshot: aa001d3d-13a6-4e25-bceb-71d55472c7be, volume: 8e40446e-ce6d-43ec-a4df-d0cd38fa8834, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:39:36 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 Feb 27 12:39:36 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:36 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3547fabb-e807-4a69-a7e1-8709834b31ba tempest-SnapshotDependencyTests-612271928 None] Created volume successfully. Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec585ecb-1dee-4e02-99eb-be3b44169f93]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:36 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be Feb 27 12:39:36 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:36 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a14dfac7-8645-4002-89a4-ffec9a30df3a" returned: 0 in 0.394s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-a14dfac7-8645-4002-89a4-ffec9a30df3a" released by "delete_volume" :: held 0.999s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created reservations ['b9bfcc76-02dd-47fa-932d-f462c1512529', '96ea5e0b-431d-41e1-b851-f765c2aad26f', '9e7cb9fb-fb2a-4c31-b2d1-121657039b95', 'e2db5c30-c8fe-424e-b231-69433f2d59fb'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:36 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887" returned: 0 in 0.541s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:36 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:36 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:36 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887 Feb 27 12:39:36 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:36 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be" returned: 0 in 0.538s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082007c0-16c4-40d9-9054-b16042ca1b9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[57195652-09e5-4e3b-909e-3f78136add2d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:36 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a Feb 27 12:39:36 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:36 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.404s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:36 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Deleted volume successfully. Feb 27 12:39:37 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-844a3fe7-98ed-4ec8-bea8-9b490fd21e43 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-a14dfac7-8645-4002-89a4-ffec9a30df3a-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-2cd69af7-d3de-4779-bf26-8fb54cee7887" returned: 0 in 0.425s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-quobyte-2cd69af7-d3de-4779-bf26-8fb54cee7887" released by "delete_volume" :: held 0.992s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Created reservations ['ea566e81-4e58-47ba-94cd-1a4a519e7427', '1e102449-06b6-4716-a39f-b7c2304e801e', '8776081f-f94d-4f9d-b718-60075ba41249', '04f628c7-2121-4a51-8212-33d9ed55f47a'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:37 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:37 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:37 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a" returned: 0 in 0.493s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:37 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 Feb 27 12:39:37 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:37 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.423s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:37 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Deleted volume successfully. Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e67b948c-1b05-4211-972c-a3423a79f674 tempest-CreateVolumesFromImageTest-540742447 None] Lock "cinder-2cd69af7-d3de-4779-bf26-8fb54cee7887-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-abac874d-9ff5-4470-9feb-a2abad5f703e-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-abac874d-9ff5-4470-9feb-a2abad5f703e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-quobyte-abac874d-9ff5-4470-9feb-a2abad5f703e" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-abac874d-9ff5-4470-9feb-a2abad5f703e" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c17e6-2c96-4905-bd53-e0739d7ef767]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:37 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:37 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e Feb 27 12:39:37 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:38 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e" returned: 0 in 1.051s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:38 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:38 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e Feb 27 12:39:38 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:39 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-abac874d-9ff5-4470-9feb-a2abad5f703e" returned: 0 in 0.939s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-abac874d-9ff5-4470-9feb-a2abad5f703e" released by "delete_volume" :: held 2.022s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created reservations ['fea90dc1-3861-4e85-a50d-eac2279d9d66', '61833c3d-c718-4a61-9ee4-78f492cdff94', '94fa3727-772f-4596-b4e1-e5de9e7801ce', '6e38508d-7cd7-43f3-93d5-521adab8fbc7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:39 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" returned: 0 in 2.518s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e497964-f415-48ca-8643-9f3dd616220d]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-15ea34bd-257e-4136-9b6b-a05fde764836-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-15ea34bd-257e-4136-9b6b-a05fde764836-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:39 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:39 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:39 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a Feb 27 12:39:39 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-quobyte-15ea34bd-257e-4136-9b6b-a05fde764836" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-15ea34bd-257e-4136-9b6b-a05fde764836" acquired by "delete_volume" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af913e-a00f-4c63-86bf-ee2b58d783ae]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:39 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:40 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 Feb 27 12:39:40 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:40 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.472s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:40 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Deleted volume successfully. Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-91e5edcb-047a-4a98-9a45-784f6c481554 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-abac874d-9ff5-4470-9feb-a2abad5f703e-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:40 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836" returned: 0 in 0.555s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:40 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836 Feb 27 12:39:40 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:40 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a" returned: 0 in 0.769s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:39:40 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Converted 1024.00 MB image at 406.03 MB/s Feb 27 12:39:40 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 is being set with open permissions: ugo+rw Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:40 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 Feb 27 12:39:40 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:40 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-15ea34bd-257e-4136-9b6b-a05fde764836" returned: 0 in 0.479s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:40 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-15ea34bd-257e-4136-9b6b-a05fde764836" released by "delete_volume" :: held 1.062s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:40 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" returned: 0 in 0.455s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" released by "_copy_volume_from_snapshot" :: held 4.864s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-aa001d3d-13a6-4e25-bceb-71d55472c7be-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" released by "_create_volume_from_snapshot" :: held 4.904s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.946s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.597s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (fdec8833-ca36-4576-96bb-d0d3d7c60009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65c459b-a897-494d-8d26-f0b41b95ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created reservations ['1fb46d5d-1205-4165-bf12-913b09091bf3', '10ff62c6-6d54-4a2b-8d16-e961c0c17aaf', '0e911d11-dfce-4d31-a148-09809d5cadd1', '31f8b581-b145-401c-ab26-0102293c53a0'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65c459b-a897-494d-8d26-f0b41b95ddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751104295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b018889-dfa2-48b0-b469-d12a2ec67faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:41Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9688013-1a3f-4d40-8769-3eb78c38b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9688013-1a3f-4d40-8769-3eb78c38b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdf198f-e42e-4124-8933-b427f121c6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdf198f-e42e-4124-8933-b427f121c6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b018889-dfa2-48b0-b469-d12a2ec67faa', 'volume_name': 'volume-7b018889-dfa2-48b0-b469-d12a2ec67faa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3dca57-de58-4c84-a2c0-a81dd851e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3dca57-de58-4c84-a2c0-a81dd851e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca30261f-adb7-49e0-bfca-d18f5506168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:41 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume 7b018889-dfa2-48b0-b469-d12a2ec67faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b018889-dfa2-48b0-b469-d12a2ec67faa', 'volume_size': 1} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3556d7fb-ff50-4a24-85ce-911ccec654c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834', 'volume_size': 1, 'snapshot_id': 'aa001d3d-13a6-4e25-bceb-71d55472c7be'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67165ba2-cb74-4e78-b3af-e533c3cbba9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Creating offline snapshot edae7110-0e5c-4646-847e-e257610f1bf2 of volume f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:39:41 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Volume volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 (8e40446e-ce6d-43ec-a4df-d0cd38fa8834): created successfully Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67165ba2-cb74-4e78-b3af-e533c3cbba9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (fcf1237f-fac6-4537-8289-74b5135526f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[30075bdd-ed75-4e30-bd45-8eae017aeb6c]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2bd95a04-4f19-47fb-b46b-73d18c4cacea tempest-VolumeDependencyTests-1884231912 None] Created volume successfully. Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:41 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:41 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:41 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 Feb 27 12:39:41 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-aa001d3d-13a6-4e25-bceb-71d55472c7be-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-aa001d3d-13a6-4e25-bceb-71d55472c7be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-082007c0-16c4-40d9-9054-b16042ca1b9a" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-082007c0-16c4-40d9-9054-b16042ca1b9a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-aa001d3d-13a6-4e25-bceb-71d55472c7be" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-aa001d3d-13a6-4e25-bceb-71d55472c7be" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Deleting offline snapshot aa001d3d-13a6-4e25-bceb-71d55472c7be of volume 082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] snapshot_file for this snap is: volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8314df9-fab5-4425-9f85-a601a5e2d586]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:41 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be Feb 27 12:39:41 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:41 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.423s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:41 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Deleted volume successfully. Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2aa41ab8-9443-4c3d-a202-a769c830b6a9 tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-15ea34bd-257e-4136-9b6b-a05fde764836-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:41 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5" returned: 0 in 0.516s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:41 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 1G Feb 27 12:39:41 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:41 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be" returned: 0 in 0.507s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082007c0-16c4-40d9-9054-b16042ca1b9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c93fff-e783-4097-b40b-77b03411f1d1]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:41 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:41 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a Feb 27 12:39:41 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-39c4df3a-40c4-454f-a373-a64fbe62b526-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-39c4df3a-40c4-454f-a373-a64fbe62b526-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "cinder-quobyte-39c4df3a-40c4-454f-a373-a64fbe62b526" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-39c4df3a-40c4-454f-a373-a64fbe62b526" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af147f3-7b36-441f-900c-73ee3dcec616]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:42 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 Feb 27 12:39:42 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:42 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 1G" returned: 0 in 0.512s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:42 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 Feb 27 12:39:42 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:42 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a" returned: 0 in 0.543s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:42 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be Feb 27 12:39:42 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:42 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526" returned: 0 in 0.506s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:42 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2" returned: 0 in 0.424s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:42 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 is being set with open permissions: ugo+rw Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:42 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526 Feb 27 12:39:42 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:42 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 Feb 27 12:39:42 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:42 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be" returned: 0 in 0.458s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:42 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:42 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be Feb 27 12:39:42 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:42 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-39c4df3a-40c4-454f-a373-a64fbe62b526" returned: 0 in 0.378s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-quobyte-39c4df3a-40c4-454f-a373-a64fbe62b526" released by "delete_volume" :: held 0.916s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Created reservations ['1941394b-8d86-4ac0-b983-ea51ffe613c3', '5291a5af-08c1-4fd8-8979-903ef5777973', '6c68c1ed-555a-4eac-b476-1c377014cc22', 'a366d5e6-23bc-403f-8802-c5f0d36cd222'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:43 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2" returned: 0 in 0.423s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:43 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:43 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:43 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.info Feb 27 12:39:43 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:43 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a.aa001d3d-13a6-4e25-bceb-71d55472c7be" returned: 0 in 0.445s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-aa001d3d-13a6-4e25-bceb-71d55472c7be" released by "_delete_snapshot" :: held 2.005s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-082007c0-16c4-40d9-9054-b16042ca1b9a" released by "delete_snapshot" :: held 2.023s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Created reservations ['1291098d-0613-47e3-965b-d23510c40c4f', '26c3c9e5-4341-427d-9088-c1b6114b1e17', 'a45c9a22-63bf-47d7-801b-0d0170416612', '15fe8f55-6807-4ce5-b9d4-153d27725d73'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Delete snapshot completed successfully. Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-58b61072-a7c9-4dbd-b263-b17135d78e82 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-aa001d3d-13a6-4e25-bceb-71d55472c7be-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:43 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.548s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:43 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:43 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Deleted volume successfully. Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.info" returned: 0 in 0.543s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:43 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.info is being set with open permissions: ugo+rw Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:43 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c20166ca-7f56-4996-8650-10b383b155fc tempest-CreateVolumesFromSourceVolumeTest-1233853780 None] Lock "cinder-39c4df3a-40c4-454f-a373-a64fbe62b526-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:43 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.info Feb 27 12:39:43 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:44 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.info" returned: 0 in 0.479s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.129s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-751104295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b018889-dfa2-48b0-b469-d12a2ec67faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:41Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Creating volume 7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:44 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:44 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e2232f60-c754-425b-92be-a6cf432e0a29 tempest-SnapshotDependencyTests-612271928 None] Create snapshot completed successfully Feb 27 12:39:44 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa 1073741824 Feb 27 12:39:44 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-082007c0-16c4-40d9-9054-b16042ca1b9a-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-082007c0-16c4-40d9-9054-b16042ca1b9a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-082007c0-16c4-40d9-9054-b16042ca1b9a" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-082007c0-16c4-40d9-9054-b16042ca1b9a" acquired by "delete_volume" :: waited 0.020s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58fddb-aedf-4e3c-8253-7d237f1d8dbf]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:44 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a Feb 27 12:39:44 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:44 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa 1073741824" returned: 0 in 0.573s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:44 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa Feb 27 12:39:44 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Flow 'volume_create_manager' (a4fc6896-095c-4a9f-978d-b58bf849ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae64974-433f-4db6-b1f5-f1a850780092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae64974-433f-4db6-b1f5-f1a850780092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159bae04-3b1c-4ec0-8c75-fde1e24ac372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37238777d7f4f0b85f29fe4744234ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:45Z,use_quota=True,user_id='7fd2a504a1444fe296acd98a0401e51b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce314ba-7d00-4209-9475-229d57cb462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce314ba-7d00-4209-9475-229d57cb462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d963f38c-3d9a-4fc8-96f5-ae5297ae4f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d963f38c-3d9a-4fc8-96f5-ae5297ae4f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159bae04-3b1c-4ec0-8c75-fde1e24ac372', 'volume_name': 'volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ac5bd1-7cf8-4294-b79e-cb30bbb25158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ac5bd1-7cf8-4294-b79e-cb30bbb25158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e373ff-7660-4a37-b322-b5ebc7008ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:44 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Volume 159bae04-3b1c-4ec0-8c75-fde1e24ac372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372', 'volume_size': 1} Feb 27 12:39:44 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:45 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a" returned: 0 in 0.615s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:45 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a Feb 27 12:39:45 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Flow 'volume_create_manager' (59a23e6a-0c6d-4f33-9524-d01eb45f1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d45017-b4a9-4ead-a6a3-ae18f6dd3ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d45017-b4a9-4ead-a6a3-ae18f6dd3ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4759dccb-e19b-45bb-8078-5d5dc38e07f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbf93d2953247a0bae1cd72336b1934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=edae7110-0e5c-4646-847e-e257610f1bf2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:45Z,use_quota=True,user_id='48acdfaec28a4cc893c726fa1c85b3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:45 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1f0d5d-cecb-42b1-8f6d-a38f7a1082ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1f0d5d-cecb-42b1-8f6d-a38f7a1082ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a772be60-571f-4ef4-a190-14e4f0372eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a772be60-571f-4ef4-a190-14e4f0372eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4759dccb-e19b-45bb-8078-5d5dc38e07f1', 'volume_name': 'volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1', 'volume_size': 1, 'snapshot_id': 'edae7110-0e5c-4646-847e-e257610f1bf2'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f6d34-c183-4b80-97d5-6fe7313e1f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f6d34-c183-4b80-97d5-6fe7313e1f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb6a5b8-c96d-4ada-832c-48b8ff3614d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:45 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Volume 4759dccb-e19b-45bb-8078-5d5dc38e07f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1', 'volume_size': 1, 'snapshot_id': 'edae7110-0e5c-4646-847e-e257610f1bf2'} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa" returned: 0 in 0.487s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159bae04-3b1c-4ec0-8c75-fde1e24ac372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37238777d7f4f0b85f29fe4744234ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:45Z,use_quota=True,user_id='7fd2a504a1444fe296acd98a0401e51b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Creating volume 159bae04-3b1c-4ec0-8c75-fde1e24ac372 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:45 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca30261f-adb7-49e0-bfca-d18f5506168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b018889-dfa2-48b0-b469-d12a2ec67faa', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb768f37-78de-4267-8a79-4dd2b7229e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:45 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 1073741824 Feb 27 12:39:45 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:45 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume volume-7b018889-dfa2-48b0-b469-d12a2ec67faa (7b018889-dfa2-48b0-b469-d12a2ec67faa): created successfully Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb768f37-78de-4267-8a79-4dd2b7229e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (fdec8833-ca36-4576-96bb-d0d3d7c60009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:45 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-f3836877-4ed8-4215-88ae-32ff9a68b261 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created volume successfully. Feb 27 12:39:45 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-082007c0-16c4-40d9-9054-b16042ca1b9a" returned: 0 in 0.441s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-082007c0-16c4-40d9-9054-b16042ca1b9a" released by "delete_volume" :: held 1.088s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Created reservations ['b4065636-9fb5-4590-8f21-c697a285c913', 'a03ffd95-1d58-49b1-a691-ff69a1b75390', '5fa7ed7e-92b5-4f58-a997-f68066283751', '25bcd5e3-8a4b-4513-995b-68f4e86cd694'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:45 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:45 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:45 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 1073741824" returned: 0 in 0.485s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:45 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:45 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 Feb 27 12:39:45 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:46 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.451s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:46 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Deleted volume successfully. Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-dd48e716-b2c7-4af4-878d-081fa1386cf3 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-082007c0-16c4-40d9-9054-b16042ca1b9a-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:46 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372" returned: 0 in 0.411s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.893s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-quobyte-edae7110-0e5c-4646-847e-e257610f1bf2-4759dccb-e19b-45bb-8078-5d5dc38e07f1" by "_create_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e373ff-7660-4a37-b322-b5ebc7008ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f861e990-6f65-419d-b84b-6dbb77f82a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-edae7110-0e5c-4646-847e-e257610f1bf2-4759dccb-e19b-45bb-8078-5d5dc38e07f1" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Creating volume 4759dccb-e19b-45bb-8078-5d5dc38e07f1 from snapshot edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-quobyte-4759dccb-e19b-45bb-8078-5d5dc38e07f1" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:46 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Volume volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 (159bae04-3b1c-4ec0-8c75-fde1e24ac372): created successfully Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f861e990-6f65-419d-b84b-6dbb77f82a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Flow 'volume_create_manager' (a4fc6896-095c-4a9f-978d-b58bf849ace4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:46 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-71437867-5f0f-4040-aedd-3823a8a5125a tempest-CinderUnicodeTest-997839706 None] Created volume successfully. Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-4759dccb-e19b-45bb-8078-5d5dc38e07f1" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] snapshot: edae7110-0e5c-4646-847e-e257610f1bf2, volume: 4759dccb-e19b-45bb-8078-5d5dc38e07f1, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a21304-ba70-4927-8007-767452a4b7fc]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:46 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 Feb 27 12:39:46 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:46 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2" returned: 0 in 0.536s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[16178ada-d130-403c-9f81-07d0c05d27b3]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:46 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 Feb 27 12:39:46 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (ab76654e-c6eb-44b4-91b5-9bd6fea72dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d45468-4650-4635-b9c6-6ad657cfffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d45468-4650-4635-b9c6-6ad657cfffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1444154972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86d99ec-0aa5-447e-8c9f-3d477308e2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feed2df41b1497fb49c5e5ec5b2e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:47Z,use_quota=True,user_id='fb949bb9311e4df8933bcddbe9872774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e4fce4-de0c-453c-8b01-a44f0507ba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e4fce4-de0c-453c-8b01-a44f0507ba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8759d868-05cc-4407-9ca4-1777cd78b41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8759d868-05cc-4407-9ca4-1777cd78b41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86d99ec-0aa5-447e-8c9f-3d477308e2ed', 'volume_name': 'volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9220f6-15d1-44f5-92e3-ca2c8b3efc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9220f6-15d1-44f5-92e3-ca2c8b3efc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7155ae84-ebb4-4a2b-be80-7f7e8799f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:46 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Volume a86d99ec-0aa5-447e-8c9f-3d477308e2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed', 'volume_size': 1} Feb 27 12:39:46 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Flow 'volume_create_manager' (910be8ab-9f22-4636-8fc2-a844c67d7bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cbfa4e-2074-4dd8-9bf6-3e6c60e062f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cbfa4e-2074-4dd8-9bf6-3e6c60e062f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-517447616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b3958e-d155-4ad9-9fdc-cddb76cac9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37238777d7f4f0b85f29fe4744234ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:47Z,use_quota=True,user_id='7fd2a504a1444fe296acd98a0401e51b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264bba63-f6b5-4932-8445-3ddaf6240f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264bba63-f6b5-4932-8445-3ddaf6240f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a39f50-9007-46e9-9dbd-1f339a22f77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a39f50-9007-46e9-9dbd-1f339a22f77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b3958e-d155-4ad9-9fdc-cddb76cac9d6', 'volume_name': 'volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399fdd77-677b-49b0-a99d-ed4b6d848f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399fdd77-677b-49b0-a99d-ed4b6d848f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac14dbfb-37c9-4200-872e-0038f31697f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:47 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Volume 60b3958e-d155-4ad9-9fdc-cddb76cac9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6', 'volume_size': 1} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:47 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5" returned: 0 in 0.529s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:39:47 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:47 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 Feb 27 12:39:47 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:49 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1" returned: 0 in 2.088s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:49 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[119ff1ff-e20e-47cb-b063-3d8e62c3bf2b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:49 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:49 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 Feb 27 12:39:49 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:50 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5" returned: 0 in 0.594s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:39:50 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Converted 1024.00 MB image at 489.94 MB/s Feb 27 12:39:50 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 is being set with open permissions: ugo+rw Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:50 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 Feb 27 12:39:50 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:50 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1" returned: 0 in 0.403s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-4759dccb-e19b-45bb-8078-5d5dc38e07f1" released by "_copy_volume_from_snapshot" :: held 4.213s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-edae7110-0e5c-4646-847e-e257610f1bf2-4759dccb-e19b-45bb-8078-5d5dc38e07f1" released by "_create_volume_from_snapshot" :: held 4.253s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.278s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.046s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Creating offline snapshot 0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a of volume 7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[69761f6b-1b75-4471-9dd7-9000b9743726]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb6a5b8-c96d-4ada-832c-48b8ff3614d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1', 'volume_size': 1, 'snapshot_id': 'edae7110-0e5c-4646-847e-e257610f1bf2'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04897cd-e041-4467-9c41-5a19d2296109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:50 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Volume volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 (4759dccb-e19b-45bb-8078-5d5dc38e07f1): created successfully Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04897cd-e041-4467-9c41-5a19d2296109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Flow 'volume_create_manager' (59a23e6a-0c6d-4f33-9524-d01eb45f1be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:50 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d26dc0da-8b17-4cc6-a1d8-6f07f8d09a36 tempest-SnapshotDependencyTests-612271928 None] Created volume successfully. Feb 27 12:39:50 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa Feb 27 12:39:50 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:50 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa" returned: 0 in 0.466s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:50 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:51 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a 1G Feb 27 12:39:51 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:51 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a 1G" returned: 0 in 0.462s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b018889-dfa2-48b0-b469-d12a2ec67faa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:51 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b018889-dfa2-48b0-b469-d12a2ec67faa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a Feb 27 12:39:51 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-edae7110-0e5c-4646-847e-e257610f1bf2-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-edae7110-0e5c-4646-847e-e257610f1bf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-quobyte-f2a69a0d-bdab-4841-9c4b-8242c88095b5" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-f2a69a0d-bdab-4841-9c4b-8242c88095b5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-quobyte-edae7110-0e5c-4646-847e-e257610f1bf2" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-edae7110-0e5c-4646-847e-e257610f1bf2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Deleting offline snapshot edae7110-0e5c-4646-847e-e257610f1bf2 of volume f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] snapshot_file for this snap is: volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a127b6ba-23a6-4ed5-b773-1e6142c41df7]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:51 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 Feb 27 12:39:51 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:51 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b018889-dfa2-48b0-b469-d12a2ec67faa -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" returned: 0 in 0.432s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:51 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a is being set with open permissions: ugo+rw Feb 27 12:39:51 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:51 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a Feb 27 12:39:51 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:52 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2" returned: 0 in 0.456s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[c584a205-18db-4009-9794-8457a41411c6]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:52 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 Feb 27 12:39:52 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:52 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" returned: 0 in 0.392s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:52 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.info Feb 27 12:39:52 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:52 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5" returned: 0 in 0.456s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:52 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 Feb 27 12:39:52 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:52 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.info" returned: 0 in 0.404s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:52 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.info is being set with open permissions: ugo+rw Feb 27 12:39:52 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:52 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.info Feb 27 12:39:52 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:53 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2" returned: 0 in 0.444s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:53 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.info" returned: 0 in 0.396s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:53 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2 Feb 27 12:39:53 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.117s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1444154972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86d99ec-0aa5-447e-8c9f-3d477308e2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feed2df41b1497fb49c5e5ec5b2e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:47Z,use_quota=True,user_id='fb949bb9311e4df8933bcddbe9872774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Creating volume a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:53 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:53 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed 1073741824 Feb 27 12:39:53 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:53 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-aa363f55-8fc4-4816-8bd2-4c4fc506d0db tempest-CreateVolumesFromSnapshotTest-1907588664 None] Create snapshot completed successfully Feb 27 12:39:53 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5.edae7110-0e5c-4646-847e-e257610f1bf2" returned: 0 in 0.398s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-edae7110-0e5c-4646-847e-e257610f1bf2" released by "_delete_snapshot" :: held 1.810s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-f2a69a0d-bdab-4841-9c4b-8242c88095b5" released by "delete_snapshot" :: held 1.823s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Created reservations ['9318e00d-f138-4d91-ac38-d84f98b7e878', '31f670c9-4244-49cd-bbbb-1e271838a88b', '274a30ab-f85d-4ef5-8015-449753cb17a5', 'd99b3992-6a4c-4ef3-a5ff-4b74459887c1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:53 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Delete snapshot completed successfully. Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-17bdef9a-d434-4a31-a09e-01309be1d761 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-edae7110-0e5c-4646-847e-e257610f1bf2-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:53 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed 1073741824" returned: 0 in 0.515s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:53 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed Feb 27 12:39:53 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-f2a69a0d-bdab-4841-9c4b-8242c88095b5-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-f2a69a0d-bdab-4841-9c4b-8242c88095b5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-quobyte-f2a69a0d-bdab-4841-9c4b-8242c88095b5" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-f2a69a0d-bdab-4841-9c4b-8242c88095b5" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a28c5b-5d4c-4880-a2ee-a5aa37be4d46]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:53 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:53 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 Feb 27 12:39:53 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (542d0b05-6247-4777-9910-9ee6748ac655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aabbf21-4a63-4868-a2c6-45068cb2a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aabbf21-4a63-4868-a2c6-45068cb2a853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246706062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20343fb4-dc55-4e11-8bbb-0f653c0b2718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:54Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbf34ee-6ca2-4378-b325-d1bb4abcc485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbf34ee-6ca2-4378-b325-d1bb4abcc485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a02893a-91fc-49ae-a086-bfb78656e2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a02893a-91fc-49ae-a086-bfb78656e2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20343fb4-dc55-4e11-8bbb-0f653c0b2718', 'volume_name': 'volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bab2eda-6ed8-4b86-bb44-259c8bac398a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bab2eda-6ed8-4b86-bb44-259c8bac398a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7630c37c-3ffc-4dc2-acf0-e4848e381183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume 20343fb4-dc55-4e11-8bbb-0f653c0b2718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718', 'volume_size': 1} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:54 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.872s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-517447616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b3958e-d155-4ad9-9fdc-cddb76cac9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d37238777d7f4f0b85f29fe4744234ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:47Z,use_quota=True,user_id='7fd2a504a1444fe296acd98a0401e51b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Creating volume 60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:54 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7155ae84-ebb4-4a2b-be80-7f7e8799f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395b5ec8-a8be-4298-ab33-e61bb9a68cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 1073741824 Feb 27 12:39:54 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:54 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Volume volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed (a86d99ec-0aa5-447e-8c9f-3d477308e2ed): created successfully Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395b5ec8-a8be-4298-ab33-e61bb9a68cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (ab76654e-c6eb-44b4-91b5-9bd6fea72dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:54 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-eb229f2a-acfd-4f88-b365-baadecfb6bc8 tempest-VolumeDependencyTests-1884231912 None] Created volume successfully. Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (f5f25fd9-17f5-4ebb-8ab0-15fb1d90b0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb1659c-f790-412a-93ac-b8c35b7acbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb1659c-f790-412a-93ac-b8c35b7acbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441664872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d153efae-c481-41e0-812b-dde87f69a6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:54Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713581b2-03eb-4660-97f2-477199ef6572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713581b2-03eb-4660-97f2-477199ef6572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beef3d5-3b57-48d7-9477-13473edab563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3beef3d5-3b57-48d7-9477-13473edab563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd153efae-c481-41e0-812b-dde87f69a6da', 'volume_name': 'volume-d153efae-c481-41e0-812b-dde87f69a6da', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e42e7-e804-4970-9111-ff08b5494b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8e42e7-e804-4970-9111-ff08b5494b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bd9e15-2c2f-4643-b912-dcd9b9f28276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume d153efae-c481-41e0-812b-dde87f69a6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d153efae-c481-41e0-812b-dde87f69a6da', 'volume_size': 1} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:54 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5" returned: 0 in 0.514s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:54 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5 Feb 27 12:39:54 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (8e0e4314-0552-4ec9-8043-1f5b239312af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddb7d44-a9ca-44c2-be6d-9d17039b7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eddb7d44-a9ca-44c2-be6d-9d17039b7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360805380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47af81d-3f48-49a4-9f3e-cd11f11827b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:54Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86fd7456-af56-4e0e-93c4-ac5b87c10cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86fd7456-af56-4e0e-93c4-ac5b87c10cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d26e94a-5284-4b34-a6e7-080586e43148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d26e94a-5284-4b34-a6e7-080586e43148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47af81d-3f48-49a4-9f3e-cd11f11827b0', 'volume_name': 'volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ba94bd-825b-4298-b57d-f5a637303303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ba94bd-825b-4298-b57d-f5a637303303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a87a07-26b1-4af6-9126-c45b109b43f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume f47af81d-3f48-49a4-9f3e-cd11f11827b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0', 'volume_size': 1} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (c2cffc33-7105-4c37-8d93-5674a2e74325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47072d25-b729-4c4d-83db-41b2f05612a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47072d25-b729-4c4d-83db-41b2f05612a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-45132468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836c4296-7119-4f69-9c09-108de8a69c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:55Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce767ed0-a791-43e2-a485-070bcb0fae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce767ed0-a791-43e2-a485-070bcb0fae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79fe88c-9848-4bc9-9455-f7f0d3b1876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79fe88c-9848-4bc9-9455-f7f0d3b1876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836c4296-7119-4f69-9c09-108de8a69c1c', 'volume_name': 'volume-836c4296-7119-4f69-9c09-108de8a69c1c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9bdacc-0861-4212-8141-7ebba7247150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9bdacc-0861-4212-8141-7ebba7247150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1978f70-949b-4cfb-8fd2-96a57b815367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume 836c4296-7119-4f69-9c09-108de8a69c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836c4296-7119-4f69-9c09-108de8a69c1c', 'volume_size': 1} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 1073741824" returned: 0 in 0.713s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:54 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 Feb 27 12:39:54 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (14caa3ea-f2e1-45b0-a4b5-4369950726e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6541da-991d-463b-a415-f8cc54a8ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:54 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6541da-991d-463b-a415-f8cc54a8ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1409317806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90d7045-503a-4bed-b175-86d11461b88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0feed2df41b1497fb49c5e5ec5b2e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a86d99ec-0aa5-447e-8c9f-3d477308e2ed,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:55Z,use_quota=True,user_id='fb949bb9311e4df8933bcddbe9872774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97378bb-af25-4132-91a9-96d6100c4809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97378bb-af25-4132-91a9-96d6100c4809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139d1641-0bf2-4e3e-9b97-83440f90b398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139d1641-0bf2-4e3e-9b97-83440f90b398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd90d7045-503a-4bed-b175-86d11461b88c', 'volume_name': 'volume-d90d7045-503a-4bed-b175-86d11461b88c', 'volume_size': 1, 'source_volid': 'a86d99ec-0aa5-447e-8c9f-3d477308e2ed', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8372193-9e95-490d-a7bb-56d48af3a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8372193-9e95-490d-a7bb-56d48af3a880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21535d66-0d06-4924-aa10-cc46a368717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Volume d90d7045-503a-4bed-b175-86d11461b88c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d90d7045-503a-4bed-b175-86d11461b88c', 'volume_size': 1, 'source_volid': 'a86d99ec-0aa5-447e-8c9f-3d477308e2ed', 'source_volstatus': 'available'} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83114) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (7271ca1f-01dd-4e17-a47a-8e873c7c3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689f3575-9019-408b-ab8a-fb903bf1fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f2a69a0d-bdab-4841-9c4b-8242c88095b5" returned: 0 in 0.659s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689f3575-9019-408b-ab8a-fb903bf1fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178248166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62003406-5adf-4b7e-991a-d3866f77c628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:55Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f425fa-a9f2-4bc1-9e41-7a6c053f47f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f425fa-a9f2-4bc1-9e41-7a6c053f47f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89230c31-d2c5-46db-a199-3be91db85918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89230c31-d2c5-46db-a199-3be91db85918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62003406-5adf-4b7e-991a-d3866f77c628', 'volume_name': 'volume-62003406-5adf-4b7e-991a-d3866f77c628', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c1aa8d-624b-48fa-b1bb-6b7e3ed66252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c1aa8d-624b-48fa-b1bb-6b7e3ed66252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d51262a-dfb1-4641-9f2b-74802144a61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume 62003406-5adf-4b7e-991a-d3866f77c628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62003406-5adf-4b7e-991a-d3866f77c628', 'volume_size': 1} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-f2a69a0d-bdab-4841-9c4b-8242c88095b5" released by "delete_volume" :: held 1.242s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Created reservations ['70883fe5-a6cc-4425-a9aa-3d4305cdfb51', '24726245-bfb9-47dc-b6e0-234b0d04d2ac', '0f9258c1-c70f-4b78-a73e-7380322dcc0a', '8dea619f-fb65-4d19-a7ba-5142bb9d80e1'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:55 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:55 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:55 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" returned: 0 in 0.471s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246706062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20343fb4-dc55-4e11-8bbb-0f653c0b2718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:54Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Creating volume 20343fb4-dc55-4e11-8bbb-0f653c0b2718 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:55 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac14dbfb-37c9-4200-872e-0038f31697f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 1073741824 Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c15e3b-4e4e-48b9-a1dc-f78aa53eedce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:55 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:55 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Volume volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 (60b3958e-d155-4ad9-9fdc-cddb76cac9d6): created successfully Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c15e3b-4e4e-48b9-a1dc-f78aa53eedce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Flow 'volume_create_manager' (910be8ab-9f22-4636-8fc2-a844c67d7bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:55 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b273954b-d5eb-4695-bc1c-901b8d90c625 tempest-CinderUnicodeTest-997839706 None] Created volume successfully. Feb 27 12:39:55 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.398s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:55 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Deleted volume successfully. Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-5a2d6965-f88b-4c6f-b7a1-09cb3c013c70 tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-f2a69a0d-bdab-4841-9c4b-8242c88095b5-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:55 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 1073741824" returned: 0 in 0.508s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:55 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 Feb 27 12:39:55 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:55 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-4759dccb-e19b-45bb-8078-5d5dc38e07f1-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-4759dccb-e19b-45bb-8078-5d5dc38e07f1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "cinder-quobyte-4759dccb-e19b-45bb-8078-5d5dc38e07f1" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-4759dccb-e19b-45bb-8078-5d5dc38e07f1" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ba3b50-26da-4aec-bbc4-6cfddc3506db]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:56 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 Feb 27 12:39:56 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:56 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718" returned: 0 in 0.448s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441664872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d153efae-c481-41e0-812b-dde87f69a6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:54Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Creating volume d153efae-c481-41e0-812b-dde87f69a6da {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:56 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7630c37c-3ffc-4dc2-acf0-e4848e381183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd02c558-80f1-4c39-8ae1-f433967795b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:56 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da 1073741824 Feb 27 12:39:56 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:56 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 (20343fb4-dc55-4e11-8bbb-0f653c0b2718): created successfully Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd02c558-80f1-4c39-8ae1-f433967795b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (542d0b05-6247-4777-9910-9ee6748ac655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:56 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-4a5884e7-f9ad-4a52-818e-3a08c1c27b19 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created volume successfully. Feb 27 12:39:56 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1" returned: 0 in 0.469s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:56 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1 Feb 27 12:39:56 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:56 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da 1073741824" returned: 0 in 0.448s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:56 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:56 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da Feb 27 12:39:56 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:57 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-4759dccb-e19b-45bb-8078-5d5dc38e07f1" returned: 0 in 0.451s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-quobyte-4759dccb-e19b-45bb-8078-5d5dc38e07f1" released by "delete_volume" :: held 0.952s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Created reservations ['271ad361-fb7b-4bee-b0f2-6c955e581c7d', 'cda13826-1859-4fc6-abbd-642210a54e08', 'c8b29b49-4573-428c-bf41-618f1acec6f8', '5c96dc0b-2c47-4c3e-96fa-75b1b22b64e3'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:57 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:39:57 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:57 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da" returned: 0 in 0.469s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360805380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47af81d-3f48-49a4-9f3e-cd11f11827b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:54Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Creating volume f47af81d-3f48-49a4-9f3e-cd11f11827b0 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:57 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bd9e15-2c2f-4643-b912-dcd9b9f28276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d153efae-c481-41e0-812b-dde87f69a6da', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:57 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 1073741824 Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5d07b9-bc34-4e55-82cd-a83c2b45267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:57 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:57 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume volume-d153efae-c481-41e0-812b-dde87f69a6da (d153efae-c481-41e0-812b-dde87f69a6da): created successfully Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5d07b9-bc34-4e55-82cd-a83c2b45267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (f5f25fd9-17f5-4ebb-8ab0-15fb1d90b0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-fec3b433-4616-4016-8701-b7f4e10a1679 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created volume successfully. Feb 27 12:39:57 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.419s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:39:57 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Deleted volume successfully. Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-2d113147-64b5-4ddc-8d19-34ef6679070a tempest-SnapshotDependencyTests-612271928 None] Lock "cinder-4759dccb-e19b-45bb-8078-5d5dc38e07f1-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:39:57 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 1073741824" returned: 0 in 0.521s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:57 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:57 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 Feb 27 12:39:57 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:58 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0" returned: 0 in 0.409s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.399s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-45132468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836c4296-7119-4f69-9c09-108de8a69c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:55Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Creating volume 836c4296-7119-4f69-9c09-108de8a69c1c {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:39:58 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a87a07-26b1-4af6-9126-c45b109b43f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48782cf5-c0cf-4c86-8767-f22400da88ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:58 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c 1073741824 Feb 27 12:39:58 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:58 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 (f47af81d-3f48-49a4-9f3e-cd11f11827b0): created successfully Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48782cf5-c0cf-4c86-8767-f22400da88ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (8e0e4314-0552-4ec9-8043-1f5b239312af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:58 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b1b7c4b6-d360-4f68-8b46-014d9bb7b4e5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created volume successfully. Feb 27 12:39:58 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c 1073741824" returned: 0 in 0.520s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:58 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:58 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c Feb 27 12:39:58 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:59 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c" returned: 0 in 0.440s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.189s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:39:59 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Cloning volume a86d99ec-0aa5-447e-8c9f-3d477308e2ed to volume d90d7045-503a-4bed-b175-86d11461b88c Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1978f70-949b-4cfb-8fd2-96a57b815367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836c4296-7119-4f69-9c09-108de8a69c1c', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59fcf6-643e-4e82-a849-342f500907c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:39:59 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume volume-836c4296-7119-4f69-9c09-108de8a69c1c (836c4296-7119-4f69-9c09-108de8a69c1c): created successfully Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b59fcf6-643e-4e82-a849-342f500907c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (c2cffc33-7105-4c37-8d93-5674a2e74325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Creating offline snapshot b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 of volume a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:39:59 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-3eb64283-9823-445b-89eb-7e2b420b4dd2 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created volume successfully. Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d38abb-b9c8-4e60-9efc-999512925d7c]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:59 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed Feb 27 12:39:59 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:39:59 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" returned: 0 in 0.525s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:39:59 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:39:59 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 1G Feb 27 12:39:59 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:00 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 1G" returned: 0 in 0.538s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:00 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 Feb 27 12:40:00 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:00 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" returned: 0 in 0.446s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:00 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 is being set with open permissions: ugo+rw Feb 27 12:40:00 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:00 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 Feb 27 12:40:00 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:01 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" returned: 0 in 0.479s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:01 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.info Feb 27 12:40:01 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:01 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.info" returned: 0 in 0.471s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:01 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.info is being set with open permissions: ugo+rw Feb 27 12:40:01 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:01 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.info Feb 27 12:40:01 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:02 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.info" returned: 0 in 0.528s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-d90d7045-503a-4bed-b175-86d11461b88c" by "_copy_volume_from_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-d90d7045-503a-4bed-b175-86d11461b88c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] snapshot: b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5, volume: d90d7045-503a-4bed-b175-86d11461b88c, {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[543acc32-e0b3-4ea9-81a4-1a8b7ac2f57a]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:02 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 Feb 27 12:40:02 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:02 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" returned: 0 in 0.547s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Creating direct copy from snapshot {{(pid=83114) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120a315-c859-4ed5-b710-b774c89aee30]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:02 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:03 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed Feb 27 12:40:03 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:03 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" returned: 0 in 0.558s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:03 devstack cinder-volume[83114]: DEBUG cinder.utils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Path /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c not found in is_blk_device check {{(pid=83114) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 12:40:03 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:03 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c Feb 27 12:40:03 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:05 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c" returned: 0 in 2.268s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:05 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb79928-58c0-4efd-af46-79eeea8577f8]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:05 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:05 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed Feb 27 12:40:05 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:06 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" returned: 0 in 0.615s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG cinder.image.image_utils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c {{(pid=83114) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 12:40:06 devstack cinder-volume[83114]: INFO cinder.image.image_utils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Converted 1024.00 MB image at 451.22 MB/s Feb 27 12:40:06 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c is being set with open permissions: ugo+rw Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:06 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c Feb 27 12:40:06 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:06 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c" returned: 0 in 0.436s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-d90d7045-503a-4bed-b175-86d11461b88c" released by "_copy_volume_from_snapshot" :: held 4.475s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Deleting offline snapshot b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 of volume a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] snapshot_file for this snap is: volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8225c1d-ad8d-49e6-a54a-e45abd5faba1]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:06 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:06 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 Feb 27 12:40:06 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_service.periodic_task [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83114) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:07 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:07 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:07 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" returned: 0 in 0.477s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68f48f9-5916-4ba8-84fc-5ea39290c091]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:07 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed Feb 27 12:40:07 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:07 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.409s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-74593749-0183-4f98-8c59-78e59ddd40f1 None None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:07 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" returned: 0 in 0.496s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:07 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:07 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 Feb 27 12:40:07 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:08 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" returned: 0 in 0.439s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:08 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5 Feb 27 12:40:08 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:08 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed.b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" returned: 0 in 0.414s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-b0e8dcf1-dbc6-4faa-9260-43e687a7b6a5" released by "_delete_snapshot" :: held 1.871s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.503s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.668s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T11:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1178248166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62003406-5adf-4b7e-991a-d3866f77c628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d983937145495d97ec7d2e52db3cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T11:39:55Z,use_quota=True,user_id='48970a89e4584bd5b2edd915f0153d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7818332f-f10c-44c1-b04c-a7a4f45659d3),volume_type_id=7818332f-f10c-44c1-b04c-a7a4f45659d3)}" {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Creating volume 62003406-5adf-4b7e-991a-d3866f77c628 {{(pid=83114) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Selected osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 as target Quobyte volume. {{(pid=83114) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 12:40:08 devstack cinder-volume[83114]: INFO cinder.volume.drivers.remotefs [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] casted to osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769 Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 1073741824 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21535d66-0d06-4924-aa10-cc46a368717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90d7045-503a-4bed-b175-86d11461b88c', 'volume_size': 1, 'source_volid': 'a86d99ec-0aa5-447e-8c9f-3d477308e2ed', 'source_volstatus': 'available'}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:40:08 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 1073741824 Feb 27 12:40:08 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54b5efa-a214-42ce-948a-6a5d0b5d65ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:40:08 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Volume volume-d90d7045-503a-4bed-b175-86d11461b88c (d90d7045-503a-4bed-b175-86d11461b88c): created successfully Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54b5efa-a214-42ce-948a-6a5d0b5d65ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:40:08 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Flow 'volume_create_manager' (14caa3ea-f2e1-45b0-a4b5-4369950726e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:40:08 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-ec7240d0-c1b4-44a4-8757-4a570464fbb0 tempest-VolumeDependencyTests-1884231912 None] Created volume successfully. Feb 27 12:40:09 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 1073741824" returned: 0 in 0.490s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:09 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 Feb 27 12:40:09 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:09 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628" returned: 0 in 0.421s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'} {{(pid=83114) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.759s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d51262a-dfb1-4641-9f2b-74802144a61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62003406-5adf-4b7e-991a-d3866f77c628', 'volume_size': 1}' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7cbf56-963f-4fb7-b436-e9494d2e47dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Creating offline snapshot 6bfb3136-ee4a-4ac3-b56e-c626e9157878 of volume 60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 12:40:09 devstack cinder-volume[83114]: INFO cinder.volume.flows.manager.create_volume [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Volume volume-62003406-5adf-4b7e-991a-d3866f77c628 (62003406-5adf-4b7e-991a-d3866f77c628): created successfully Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7cbf56-963f-4fb7-b436-e9494d2e47dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83114) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Flow 'volume_create_manager' (7271ca1f-01dd-4e17-a47a-8e873c7c3849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83114) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f9c8a9-295e-4669-87b4-594d748d93ed]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:09 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-5b788b29-55cc-4b6c-aa26-aba0db60e52f tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created volume successfully. Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-a86d99ec-0aa5-447e-8c9f-3d477308e2ed-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-a86d99ec-0aa5-447e-8c9f-3d477308e2ed-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ee33ed-9c24-4864-88c6-48b9a42a0314]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:09 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 Feb 27 12:40:09 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:09 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed Feb 27 12:40:09 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-62003406-5adf-4b7e-991a-d3866f77c628-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:09 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-62003406-5adf-4b7e-991a-d3866f77c628-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-62003406-5adf-4b7e-991a-d3866f77c628" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-62003406-5adf-4b7e-991a-d3866f77c628" acquired by "delete_volume" :: waited 0.013s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec7f4d2-eb01-4528-bc96-29962d3ccc89]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:10 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 Feb 27 12:40:10 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:10 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" returned: 0 in 0.523s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 1G {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:10 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 1G Feb 27 12:40:10 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:10 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" returned: 0 in 0.523s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:10 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed Feb 27 12:40:10 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:10 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628" returned: 0 in 0.502s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:10 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628 Feb 27 12:40:10 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:10 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 1G" returned: 0 in 0.493s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:10 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 Feb 27 12:40:10 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:10 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" returned: 0 in 0.429s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-a86d99ec-0aa5-447e-8c9f-3d477308e2ed" released by "delete_volume" :: held 0.980s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Created reservations ['fd8f74da-a2d9-46ec-a583-8398b185a48f', 'f481845c-763c-43a1-8aee-c4f9078f9840', 'f478270f-73ea-4be1-89c7-230cb4a8d3fe', '84874a00-032c-4fba-b30e-9fa33d6a29a3'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:10 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:10 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:10 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-62003406-5adf-4b7e-991a-d3866f77c628" returned: 0 in 0.438s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:10 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-62003406-5adf-4b7e-991a-d3866f77c628" released by "delete_volume" :: held 0.962s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created reservations ['044580a8-34cc-4880-8433-a6aa78859f6a', '9f6b15c8-fa0f-421e-a1b6-54f09a013a69', 'a0406e37-4c94-425a-8b3e-aaf5976b6243', 'c1511348-d6e7-49cd-9bc7-35d3bc192509'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-836c4296-7119-4f69-9c09-108de8a69c1c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-836c4296-7119-4f69-9c09-108de8a69c1c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:11 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:11 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-836c4296-7119-4f69-9c09-108de8a69c1c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-836c4296-7119-4f69-9c09-108de8a69c1c" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef521d-3309-4ab1-b7b5-2f6580e90734]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:11 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c Feb 27 12:40:11 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:11 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 -F qcow2 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:11 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 is being set with open permissions: ugo+rw Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:11 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 Feb 27 12:40:11 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:11 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.484s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Deleted volume successfully. Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=146,cinder:INSERT=49,cinder:UPDATE=250,cinder:DELETE=23 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-03df1327-6133-4341-b7a9-5d22a73baf31 tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-a86d99ec-0aa5-447e-8c9f-3d477308e2ed-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:11 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.486s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:11 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Deleted volume successfully. Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-93766889-f4ee-4268-a693-c7f939a1a9fd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-62003406-5adf-4b7e-991a-d3866f77c628-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:11 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c" returned: 0 in 0.536s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:11 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c Feb 27 12:40:11 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:11 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878" returned: 0 in 0.433s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:INSERT=55,cinder:UPDATE=203,cinder:SELECT=176,cinder:DELETE=21 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:11 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.info Feb 27 12:40:11 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-d90d7045-503a-4bed-b175-86d11461b88c-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:11 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-d90d7045-503a-4bed-b175-86d11461b88c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-d90d7045-503a-4bed-b175-86d11461b88c" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-d90d7045-503a-4bed-b175-86d11461b88c" acquired by "delete_volume" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[17526b28-bdb8-4e58-ac2e-2dff903d18a5]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:12 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c Feb 27 12:40:12 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:12 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-836c4296-7119-4f69-9c09-108de8a69c1c" returned: 0 in 0.437s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-836c4296-7119-4f69-9c09-108de8a69c1c" released by "delete_volume" :: held 0.998s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created reservations ['fcd11c64-846e-4444-a6c0-2a9686ea7588', '8b5d1f8c-54d0-43af-8c33-b313ae5017ab', '3cb87fbb-b96a-49e3-9f79-a9b382e24e28', '7814820c-7dd5-46d9-8f26-3480e5e8d269'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:12 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.info" returned: 0 in 0.439s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:12 devstack cinder-volume[83114]: WARNING cinder.volume.drivers.remotefs [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.info is being set with open permissions: ugo+rw Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.info {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:12 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.info Feb 27 12:40:12 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:12 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:12 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:12 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c" returned: 0 in 0.532s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:12 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c Feb 27 12:40:12 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:12 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.info" returned: 0 in 0.417s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-eaca51ec-3129-4c1a-af6d-9aaaa42c33eb tempest-CinderUnicodeTest-997839706 None] Create snapshot completed successfully Feb 27 12:40:12 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.436s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:12 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Deleted volume successfully. Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-0f9d38fc-54bc-47ed-838c-b63346e927ea tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-836c4296-7119-4f69-9c09-108de8a69c1c-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:12 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d90d7045-503a-4bed-b175-86d11461b88c" returned: 0 in 0.408s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-d90d7045-503a-4bed-b175-86d11461b88c" released by "delete_volume" :: held 0.961s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:12 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Created reservations ['67387c3f-34b6-46b0-a2af-6c7a6fcceaf0', '75e18e12-3496-4bcb-85e2-cbb5b1f83344', 'e7278cf5-3f69-4720-a5f8-497f8c8db19e', 'c655e796-b3d4-4f3d-bc12-3e0d4f0d16e0'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:13 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:13 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-8e40446e-ce6d-43ec-a4df-d0cd38fa8834-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-8e40446e-ce6d-43ec-a4df-d0cd38fa8834-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "cinder-quobyte-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" acquired by "delete_volume" :: waited 0.020s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[3115d32b-6172-4a32-9756-b16756958f9b]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:13 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 Feb 27 12:40:13 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-f47af81d-3f48-49a4-9f3e-cd11f11827b0-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-f47af81d-3f48-49a4-9f3e-cd11f11827b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-f47af81d-3f48-49a4-9f3e-cd11f11827b0" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-f47af81d-3f48-49a4-9f3e-cd11f11827b0" acquired by "delete_volume" :: waited 0.017s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e2512c-6ef5-4606-b712-9f4e090a16fd]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:13 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 Feb 27 12:40:13 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:13 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.479s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:13 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Deleted volume successfully. Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cdd5c280-accd-4e74-85c6-27f5bfd3d0aa tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-d90d7045-503a-4bed-b175-86d11461b88c-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "cinder-6bfb3136-ee4a-4ac3-b56e-c626e9157878-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-6bfb3136-ee4a-4ac3-b56e-c626e9157878-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "cinder-quobyte-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "cinder-quobyte-6bfb3136-ee4a-4ac3-b56e-c626e9157878" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-6bfb3136-ee4a-4ac3-b56e-c626e9157878" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Deleting offline snapshot 6bfb3136-ee4a-4ac3-b56e-c626e9157878 of volume 60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] snapshot_file for this snap is: volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[797d8d95-8ed4-4956-a558-ba79c91b1031]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:13 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 Feb 27 12:40:13 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:13 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" returned: 0 in 0.563s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:13 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834 Feb 27 12:40:13 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:13 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0" returned: 0 in 0.531s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:13 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:13 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0 Feb 27 12:40:13 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:14 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878" returned: 0 in 0.486s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8adeda-7414-48ed-8bc2-c7bca7d0f636]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:14 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" returned: 0 in 0.428s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-quobyte-8e40446e-ce6d-43ec-a4df-d0cd38fa8834" released by "delete_volume" :: held 1.012s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:14 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 Feb 27 12:40:14 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Created reservations ['ab369624-6c64-4dce-be7a-60d41db7837f', '60f05071-d0b2-4e6d-8740-db5ccd7805de', 'a8cd5ca0-a24c-4ebf-8be2-e66a0dd77494', '5b5e188c-9b3c-4cf1-b158-b6b980873aa8'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:14 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:14 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:14 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-f47af81d-3f48-49a4-9f3e-cd11f11827b0" returned: 0 in 0.447s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-f47af81d-3f48-49a4-9f3e-cd11f11827b0" released by "delete_volume" :: held 1.006s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created reservations ['a58262ae-8f64-4542-9a68-c7860b7d313e', 'c8558adf-ed0a-48f7-b9b5-41f4029ae5b4', '825ff907-bbb2-4e27-9749-9abb0c44a0ee', 'c651e899-acd7-4800-906a-e2e5bc46508b'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:14 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:14 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:14 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" returned: 0 in 0.534s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:14 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 Feb 27 12:40:14 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:14 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.454s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Deleted volume successfully. Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b2e90bae-2579-4e59-af20-ab8e313862fe tempest-VolumeDependencyTests-1884231912 None] Lock "cinder-8e40446e-ce6d-43ec-a4df-d0cd38fa8834-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:14 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.428s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:14 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Deleted volume successfully. Feb 27 12:40:14 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b85a31a7-fe45-45be-a9fd-0d37e76aa6c5 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-f47af81d-3f48-49a4-9f3e-cd11f11827b0-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:15 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878" returned: 0 in 0.450s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:15 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878 Feb 27 12:40:15 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-d153efae-c481-41e0-812b-dde87f69a6da-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-d153efae-c481-41e0-812b-dde87f69a6da-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-d153efae-c481-41e0-812b-dde87f69a6da" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-d153efae-c481-41e0-812b-dde87f69a6da" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d99e5f0-9b55-41ca-900c-f9f32d88b6d3]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:15 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6.6bfb3136-ee4a-4ac3-b56e-c626e9157878" returned: 0 in 0.470s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-6bfb3136-ee4a-4ac3-b56e-c626e9157878" released by "_delete_snapshot" :: held 2.011s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" released by "delete_snapshot" :: held 2.021s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Created reservations ['d7955dfb-badd-4158-b028-2ddcf591df99', '5a3c0e6e-563b-41e0-a024-6b7eb12e31a3', 'cd637fbe-5c96-41f4-97ec-9dfab388b499', '536af648-4174-454c-b518-580384a1e390'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:15 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da Feb 27 12:40:15 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:15 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Delete snapshot completed successfully. Feb 27 12:40:15 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8825497a-73c9-457f-8c32-807c20c2c543 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-6bfb3136-ee4a-4ac3-b56e-c626e9157878-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:16 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da" returned: 0 in 0.580s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:16 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da Feb 27 12:40:16 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:16 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-d153efae-c481-41e0-812b-dde87f69a6da" returned: 0 in 0.432s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-d153efae-c481-41e0-812b-dde87f69a6da" released by "delete_volume" :: held 1.041s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created reservations ['530f6bd5-acd8-40f7-ab58-10e0cf815dd0', 'a545463a-717b-4040-87b5-81ca6db779ae', 'f535c421-2ec3-45cc-8f45-d915db3dd318', 'a56f48b0-b363-48ff-bb5b-857ca0445bb7'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:16 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:16 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "cinder-60b3958e-d155-4ad9-9fdc-cddb76cac9d6-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-60b3958e-d155-4ad9-9fdc-cddb76cac9d6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "cinder-quobyte-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[52264345-8863-417e-be2f-58f220fdfcb0]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:16 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:16 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 Feb 27 12:40:16 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:17 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.446s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:17 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Deleted volume successfully. Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-cc71f2af-7589-4669-a230-e5825611ab12 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-d153efae-c481-41e0-812b-dde87f69a6da-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:17 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" returned: 0 in 0.489s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:17 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6 Feb 27 12:40:17 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-20343fb4-dc55-4e11-8bbb-0f653c0b2718-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-20343fb4-dc55-4e11-8bbb-0f653c0b2718-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-20343fb4-dc55-4e11-8bbb-0f653c0b2718" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-20343fb4-dc55-4e11-8bbb-0f653c0b2718" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53db9f6-fd36-4b45-a772-a1d06d081dae]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:17 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" returned: 0 in 0.446s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-60b3958e-d155-4ad9-9fdc-cddb76cac9d6" released by "delete_volume" :: held 0.969s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Created reservations ['23c99250-0692-4409-b8af-1a26a8e01f97', 'fb7e7e16-2955-4fc6-9b18-daf090f2b7fa', '0f18cd0a-6fcc-42b2-801e-24048be3d97a', '6f84d798-2da9-4154-8f34-cb9cfac14ef5'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:17 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:17 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:17 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:17 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "cinder-159bae04-3b1c-4ec0-8c75-fde1e24ac372-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-159bae04-3b1c-4ec0-8c75-fde1e24ac372-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "cinder-quobyte-159bae04-3b1c-4ec0-8c75-fde1e24ac372" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-159bae04-3b1c-4ec0-8c75-fde1e24ac372" acquired by "delete_volume" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfacfe5-e830-40d7-ac75-515111066926]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:17 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:17 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 Feb 27 12:40:17 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:18 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718" returned: 0 in 0.521s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:18 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.447s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:18 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Deleted volume successfully. Feb 27 12:40:18 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718 Feb 27 12:40:18 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-b3e25f01-adc6-4a56-8dfd-6d0a14dac529 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-60b3958e-d155-4ad9-9fdc-cddb76cac9d6-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:18 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372" returned: 0 in 0.486s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:18 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372 Feb 27 12:40:18 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:18 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-20343fb4-dc55-4e11-8bbb-0f653c0b2718" returned: 0 in 0.421s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-20343fb4-dc55-4e11-8bbb-0f653c0b2718" released by "delete_volume" :: held 0.968s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created reservations ['429d7cfb-972b-4233-b587-04aae6836271', '2d69953f-c67c-4c37-9e7c-2b1a00459f12', '9bb00679-cb68-41bc-abee-c5ca0d0b64a4', '0ac50c2c-ca00-4c28-a3b8-2ec77bc2d0c5'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:18 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:18 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a-delete_snapshot" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-7b018889-dfa2-48b0-b469-d12a2ec67faa" by "delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-7b018889-dfa2-48b0-b469-d12a2ec67faa" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" by "_delete_snapshot" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Deleting offline snapshot 0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a of volume 7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] snapshot_file for this snap is: volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a {{(pid=83114) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac518b0c-caac-462f-88c5-098ceb11cdcf]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:18 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-159bae04-3b1c-4ec0-8c75-fde1e24ac372" returned: 0 in 0.449s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-quobyte-159bae04-3b1c-4ec0-8c75-fde1e24ac372" released by "delete_volume" :: held 0.956s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Created reservations ['a8f8c94e-28e3-444f-87d0-b50202e810fc', 'c1500df9-6753-408d-8213-65d355f0d9e6', 'b750e9b9-8940-47b8-83f4-c71cad1117f0', 'cb8a84ab-f56b-44e2-8758-c9c7e0821aa2'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:18 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a Feb 27 12:40:18 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:18 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:18 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:18 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:19 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.513s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Deleted volume successfully. Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-d4d7c99b-beb2-478c-a92c-624d785a1279 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-20343fb4-dc55-4e11-8bbb-0f653c0b2718-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:19 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" returned: 0 in 0.562s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.remotefs [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b018889-dfa2-48b0-b469-d12a2ec67faa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83114) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc714940-335f-4886-a272-c78a1d2268ab]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:19 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.502s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:19 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Deleted volume successfully. Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-c7d9d7d3-6f8d-46af-aab4-bdf307b35620 tempest-CinderUnicodeTest-997839706 None] Lock "cinder-159bae04-3b1c-4ec0-8c75-fde1e24ac372-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:19 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa Feb 27 12:40:19 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:19 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa" returned: 0 in 0.507s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:19 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:19 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a Feb 27 12:40:19 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:20 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" returned: 0 in 0.491s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:20 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a Feb 27 12:40:20 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:20 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:20 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa.0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" returned: 0 in 0.403s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a" released by "_delete_snapshot" :: held 2.025s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-7b018889-dfa2-48b0-b469-d12a2ec67faa" released by "delete_snapshot" :: held 2.038s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:20 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created reservations ['f46746dd-1e63-4b96-bae9-3ca2bc731ace', '1fb36ec2-1d4d-4fb6-aedc-876f1a2ac2fa', '2d42bc4a-9fc9-4ffb-9dbc-e28aca4a25e0', 'babbb1b6-3b77-4042-a354-31ef1b36dd62'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:20 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Delete snapshot completed successfully. Feb 27 12:40:20 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-e90c3a53-eabc-4e75-b138-4074d0fe0fe7 tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-0fb0b033-d781-4d9f-bd66-c4c2a9b61a4a-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-7b018889-dfa2-48b0-b469-d12a2ec67faa-delete_volume" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-7b018889-dfa2-48b0-b469-d12a2ec67faa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "cinder-quobyte-7b018889-dfa2-48b0-b469-d12a2ec67faa" by "delete_volume" {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 12:40:21 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-7b018889-dfa2-48b0-b469-d12a2ec67faa" acquired by "delete_volume" :: waited 0.011s {{(pid=83114) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 12:40:21 devstack cinder-volume[83114]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e497cd-687f-437f-ba15-c5385f7765a9]: (4, 'qcow2') {{(pid=83750) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 12:40:21 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:22 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa Feb 27 12:40:22 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:22 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa" returned: 0 in 0.470s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:22 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa Feb 27 12:40:22 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:22 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad/volume-7b018889-dfa2-48b0-b469-d12a2ec67faa" returned: 0 in 0.397s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-quobyte-7b018889-dfa2-48b0-b469-d12a2ec67faa" released by "delete_volume" :: held 0.897s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG cinder.quota [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Created reservations ['c10bbd04-7bbb-4e5f-a2ce-49440e566426', '054c1c1c-f77b-4662-8eab-9ec96872c566', '9dfc55f0-d2a5-437b-a48d-a95bb41da649', 'b3474f6b-4bac-4e88-88e9-65c38f49deeb'] {{(pid=83114) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769': None} {{(pid=83114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG cinder.volume.drivers.quobyte [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23daea5a-185e-4a95-964d-30baaaf51769'] {{(pid=83114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.lockutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83114) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 12:40:22 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 12:40:22 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad Feb 27 12:40:22 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 12:40:23 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Feb 27 12:40:23 devstack cinder-volume[83114]: DEBUG oslo_concurrency.processutils [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ccd39deea9687a9e9602b1d86211aad" returned: 0 in 0.453s {{(pid=83114) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 12:40:23 devstack cinder-volume[83114]: DEBUG cinder.manager [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Notifying Schedulers of capabilities ... {{(pid=83114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 12:40:23 devstack cinder-volume[83114]: INFO cinder.volume.manager [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Deleted volume successfully. Feb 27 12:40:23 devstack cinder-volume[83114]: DEBUG cinder.coordination [None req-8cddf36f-6cc7-4955-a8f3-7460603670dd tempest-CreateVolumesFromSnapshotTest-1907588664 None] Lock "cinder-7b018889-dfa2-48b0-b469-d12a2ec67faa-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=83114) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 12:40:32 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:SELECT=53,cinder:UPDATE=81,cinder:DELETE=3,cinder:INSERT=21 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 12:40:33 devstack cinder-volume[83114]: DEBUG dbcounter [-] [83114] Writing DB stats cinder:DELETE=8,cinder:SELECT=61,cinder:UPDATE=86,cinder:INSERT=24 {{(pid=83114) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}